TradingAgents/tradingagents/dataflows
Youssef Aitousarrah e15e2df7a5 feat(cache): unified ticker universe + nightly OHLCV prefetch
- tradingagents/dataflows/universe.py: single source of truth for ticker
  universe; all scanners now call load_universe(config) instead of
  duplicating the 3-level fallback chain with hardcoded "data/tickers.txt"

- scripts/prefetch_ohlcv.py: nightly script using existing ohlcv_cache.py
  incremental logic; first run downloads 1y history, subsequent runs append
  only new trading days

- .github/workflows/prefetch.yml: runs at 01:00 UTC daily, before all other
  workflows; commits updated parquet to repo

- Updated 6 scanners: minervini, high_52w_breakout, ml_signal, options_flow,
  sector_rotation, technical_breakout — removed duplicate DEFAULT_TICKER_FILE
  constants and _load_tickers_from_file() functions

- minervini, high_52w_breakout, technical_breakout: replace yf.download()
  with download_ohlcv_cached() — reads from prefetched cache instead of
  hitting yfinance at discovery time

- default_config.py: added discovery.ohlcv_cache_dir config key

- data/ohlcv_cache/: initial 1y backfill (588 tickers, 5.4MB parquet)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-04-14 16:18:52 -07:00
..
discovery feat(cache): unified ticker universe + nightly OHLCV prefetch 2026-04-14 16:18:52 -07:00
__init__.py WIP 2025-09-26 16:17:50 +08:00
alpha_vantage.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
alpha_vantage_analysts.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
alpha_vantage_common.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
alpha_vantage_fundamentals.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
alpha_vantage_indicator.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
alpha_vantage_news.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
alpha_vantage_stock.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
alpha_vantage_volume.py chore: linter formatting + ML scanner logging, prompt control, ranker reasoning 2026-02-09 23:04:38 -08:00
config.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
delisted_cache.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
finnhub_api.py chore: linter formatting + ML scanner logging, prompt control, ranker reasoning 2026-02-09 23:04:38 -08:00
finviz_scraper.py learn(iterate): 2026-04-13 — automated iteration run 2026-04-13 07:52:59 +00:00
fmp_api.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
google.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
googlenews_utils.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
interface.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
local.py chore: linter formatting + ML scanner logging, prompt control, ranker reasoning 2026-02-09 23:04:38 -08:00
market_data_utils.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
news_semantic_scanner.py Update 2026-02-20 08:39:37 -08:00
openai.py fix(filter): replace tqdm with logger in batch news functions to fix I/O error 2026-04-06 13:46:21 -07:00
reddit_api.py fix(filter): replace tqdm with logger in batch news functions to fix I/O error 2026-04-06 13:46:21 -07:00
reddit_utils.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
semantic_discovery.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
stockstats_utils.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
technical_analyst.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
ticker_semantic_db.py Remore unused code and improve the UI 2026-02-16 14:17:43 -08:00
tradier_api.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
twitter_data.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
universe.py feat(cache): unified ticker universe + nightly OHLCV prefetch 2026-04-14 16:18:52 -07:00
utils.py feat: discovery pipeline enhancements with ML signal scanner 2026-02-09 22:53:42 -08:00
y_finance.py fix(y_finance): make suppress_yfinance_warnings thread-safe 2026-04-07 16:37:03 -07:00