Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
October 21, 2024
·
Atlanta
PitchGhost: Scaling Millions of Tokens
Learn how to process millions of tokens daily by sending thousands of social media posts to LLMs, with code and tools for reliable, large-scale AI systems.
Overview
PitchGhost scans through thousands of social media posts a day for our customers. As part of this scanning process, we send nearly all of those posts to LLMs to be screened and processed. This ends with us sending on average 10k+ requests a day and processing over 50 million tokens every day! I want to share some code and tools we use to make this process as reliable as possible.
Links
Prompt-based smart filtering monitors social media for qualified leads, syncing CRMs.