My answer to AiSuite - focused even more on the GPU-poor. It's still in early development, but you can take a look here: github.com/mobarski/ai-... All feedback is more than welcome (comments, likes, github stars, reposts). - ThreadSky

About ThreadSky

datageek-pl.bsky.social • 92 days ago

My answer to AiSuite - focused even more on the GPU-poor.
It's still in early development, but you can take a look here:
https://github.com/mobarski/ai-bricks-v3

All feedback is more than welcome (comments, likes, github stars, reposts).

Comments

julianharris.bsky.social•90 days ago

I'm struggling to understand the value of adding abstractions above the abstraction the industry is already using which is OpenAI's API emulation. Teach me here the job to be done that isn't being done well enough without further wrappers 🙏

datageek-pl.bsky.social•90 days ago

It minimizes/localizes changes required in the original codebase as every provider/adapter/backend has some nuance.

It allows introducing significant changes by adding middleware - imagine adding automatic context summarization after reaching certain threshold - without any change in orig codebase.

datageek-pl.bsky.social•90 days ago

Also on a very shallow level it enables easy switching models and providers - by changing just the connection string. It facilitates rapid experimentation.

julianharris.bsky.social•90 days ago

If you can help make that possible it'd be greatly appreciated. When I did this before with langchain it still required basically another per-LLM customisation layer. E.g. https://github.com/boxabirds/text2sql-prompt-engineering/blob/main/ecommerce-1/llms.go (I know it's in go but same applies to python)

datageek-pl.bsky.social•90 days ago

I think it’s a common pain point and Andrew Ng decided to address it in the AiSuite. Initially I was planning to refactor my other projects to use his module but I quickly realized that I (and probably others) need something different.

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply