mirror of
https://github.com/SFKislev/The-News.git
synced 2026-09-14 19:52:07 +08:00
c5b2f19c29
- Introduced `cctv-news-fetcher` for fetching news highlights from CCTV News Broadcast. - Added `daily-news-brief` skill for automated daily news summaries across various topics. - Implemented `hot-news-aggregator` to compile social, tech, and military news. - Created `market-news` skill for summarizing financial news and market dynamics. - Updated `.gitignore` to include environment files for security.
Embedding experiments
Reproduces ClawHub's vector-search scoring locally so we can iterate on description / SKILL.md wording without republishing.
What it does
- Pulls the actually-published frontmatter + SKILL.md (+ small bundled files)
for
the-news,cctv-news-fetcher, and other competitors via ClawHub's public Convex HTTP API. - Rebuilds the exact embedding-input string ClawHub builds (
buildEmbeddingText), truncated to 12_000 chars. - Embeds each one with
text-embedding-3-small(1536 dims, same model ClawHub uses). - Embeds a list of query terms (
news,headlines, etc.) with no preprocessing, matching ClawHub'sargs.query.trim()at search time. - Computes cosine similarity (Convex vector-index default metric).
- Prints both absolute scores and the gap to
the-news.
Run
pip install openai numpy
set OPENAI_API_KEY=sk-...
python compare.py
Cost: ~$0.001 per run. Embedding-3-small is $0.02 per 1M tokens.
Workflow for iterating
- Run baseline — observe gap to
cctv-news-fetcheron querynews. - Edit a local copy of
SKILL.md/ description, save in this dir as e.g.variant_v1_skill.md. - Modify
compare.pyto add a fake "skill" entry that reads from the local variant instead of fetching from Convex. - Re-run, see if cosine for
newsmoves up. - When a variant beats CCTV on
newswithout losing on other queries, ship it.