8 Comments
User's avatar
Subramani Aatreya's avatar

This's so cool. Will try. Thanks for the work!

Expand full comment
Ryan Ong, Ph.D. 🎮's avatar

Great to hear, let me know what you think once you tried it!

Expand full comment
Daria Cupareanu's avatar

This is awesome, Ryan! So cool to see you bring the search product idea to life so quickly. Happy to see it come together!

Expand full comment
Ryan Ong, Ph.D. 🎮's avatar

Thank you Daria! I am excited about this one and hope you and the Substack community would enjoy it :)

Expand full comment
Jenny Ouyang's avatar

Fantastic read, really impressed by what you’ve built!

Quick question: did you store all the newsletter data from Substack into your own database? I ask because I noticed the subscriber counts don’t always match the live numbers on Substack.

Also, if you did ingest all that data, how did you go about finding the relevant articles in the first place?

I was even able to find my own posts, which felt pretty awesome!

Thanks again for sharing all the behind-the-scenes details, incredible work!

Expand full comment
Ryan Ong, Ph.D. 🎮's avatar

Thank you Jenny! Glad you are enjoying the posts :)

I haven’t digest all the articles yet as I am still finalising the ingestion pipeline. This will be my focus this week. Currently, it’s a small database. It only has articles from creators I created chatbots for and that’s why you were able to fjnd your posts :) And subscriber counts isn’t automated yet so I have to manually add and edit them 😬

Also it’s not uptodate yet. Essentially, the ingestion pipeline needs work and be automated this week :)

Expand full comment
Jenny Ouyang's avatar

That makes sense now, still, it’s a great job done!

Expand full comment
Intoobus's avatar

Hey! I saw your post pop up on my homepage and wanted to show some support. If you get a chance, I’d really appreciate a little love on my latest newsletter too always happy to boost each other!

Expand full comment