Algorithm Development Intern

Designed and deployed a real-time feed deduplication system to enhance user experience and content diversity for social media app.

• Leveraged large-scale data streaming pipelines (Kafka, Spark) and advanced similarity detection methods (simhash, Bloom filters) to filter redundant multi-media data.
• Reduced repetitive text exposure by ~90% and duplicate video content by ~30%.