home/categories/llm-ai/x-mckay-kubani-skills-news-collection-filter-duplicates-skill-md
llm-aidata-ai

filter-duplicates

Fast pre-filter to remove articles already processed. Uses Redis for O(1) URL lookup to avoid wasting LLM calls on previously seen content.

X-McKay
maintainer
X-McKay
Updated 1/16/2026
Stars
1
Forks
0
quick start

Installation and usage

Fast pre-filter to remove articles already processed. Uses Redis for O(1) URL lookup to avoid wasting LLM calls on previously seen content.

Installation
$ install --globalskills.sh
Usage

Once installed, you can use this skill by running the following command in your terminal:

skills use filter-duplicates