That actually sounds like a pretty great use case for your app. Currently just openai - the structured output in the API makes it pretty good for indexing.
Comments
Log in with your Bluesky account to leave a comment
Nice yeah their API is awesome, so easy. But, if my app got a huge influx of users posting as usual or if one person made millions of spam posts, etc I’d have a big bill!
I’m thinking self-hosting something like llama might be the way to go, hopefully someone has made a nice free api and wrapper
Comments
I’m thinking self-hosting something like llama might be the way to go, hopefully someone has made a nice free api and wrapper