Commit Graph

12 Commits

Author SHA1 Message Date
Martin C. Richards 5af339998b
feat(news): add vector embeddings and real OpenRouter integration to Dagster workflows
- Add title_embedding and content_embedding fields to NewsArticle entity
- Integrate real OpenRouter sentiment analysis in fetch_and_process_article
- Integrate real OpenRouter embedding generation in Dagster workflows
- Add database migration for sentiment_confidence and sentiment_label fields
- Fix Alembic version number format escaping (%%04d)
- Update Dagster metadata to use MetadataValue types for proper display
- Add comprehensive error handling with fallbacks for OpenRouter failures
- Add tests for Dagster OpenRouter integration and sentiment field migrations
2025-11-16 17:42:24 +01:00
Martin C. Richards f9fdb5a26d
feat(news): implement complete news service with LLM sentiment analysis and Dagster orchestration 2025-11-16 12:14:40 +01:00
Martin C. Richards c5ced8cd66
feat(news): enhance NewsArticle entity with sentiment fields and add Dagster orchestration specs
- Add sentiment_confidence and sentiment_label fields to NewsArticle
- Update database configuration for PostgreSQL + TimescaleDB + pgvectorscale
- Add comprehensive Dagster orchestration specifications
- Update project dependencies and tooling configuration
- Enhance test coverage for news repository functionality
- Align news domain specs with project roadmap and architecture
2025-11-14 22:18:33 +01:00
Martin C. Richards c20771bf20
docs: Adopt Spec-Driven Development framework
Establish complete Spec-Driven Development documentation structure to
enable AI-assisted implementation with product context, feature specs,
and architectural standards.

Documentation:
- Add product docs (product.md, roadmap.md) for business context
- Add feature specs for marketdata, news, and socialmedia domains
- Add technical standards (practices.md, security.md, style.md, tech.md)
- Update README with SDD workflow and PostgreSQL architecture

Restructure:
- Move Docker files to docker/db/ for cleaner organization
- Move docker-compose.yml to project root
- Remove deprecated configs (litellm.yml, package.json, setup.py)
- Update tests for pytest-vcr integration

This establishes the foundation for /spec:* workflow commands and
structured AI-agent collaboration.
2025-11-11 22:28:54 +01:00
Martin C. Richards 4565a41600 rm vcrs 2025-08-17 18:15:29 +02:00
Martin C. Richards 873ff99173 add db 2025-08-17 17:59:34 +02:00
Martin C. Richards 6a2535f101 fix lint 2025-08-16 14:03:28 +02:00
Martin C. Richards fd45639ad6 typecheck with pyrefly 2025-08-16 13:52:37 +02:00
Martin C. Richards 1cfe018f77 test: implement pytest-vcr for article scraper with zero mocks
- Replace all mocking with pytest-vcr for real HTTP recording
- Add comprehensive test coverage for major news sources
- Test realistic scenarios: paywalls, 404s, successful scraping
- Update dependencies: googlenewsdecoder, nltk, lxml-html-clean
- Fix lint issue: simplify conditional return statement
- Update documentation to reflect testing progress

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-08-16 11:02:37 +02:00
Martin C. Richards d773ed4cfa refactor: migrate to newspaper4k and improve news service repository integration
- Upgrade from newspaper3k to newspaper4k for better article scraping
- Add repository integration for cached news data retrieval
- Implement proper date handling and data conversion in news service
- Move PRD files to dedicated prd/ directory
- Add type stubs and improve type checking configuration
- Fix linting issues (unused variables and loop control variables)

🤖 Generated with Claude Code

Co-Authored-By: Claude <noreply@anthropic.com>
2025-08-10 13:00:40 +02:00
Yijia Xiao 5aca7124bd Revert "Docker support and Ollama support (#47)" (#57)
This reverts commit 78ea029a0b.
2025-06-26 00:07:58 -04:00
Geeta Chauhan 42069ed7ab Docker support and Ollama support (#47)
- Added support for running CLI and Ollama server via Docker
- Introduced tests for local embeddings model and standalone Docker setup
- Enabled conditional Ollama server launch via LLM_PROVIDER
2025-06-25 23:57:05 -04:00