Ask HK: How are you building AI apps today?

Generally curious how folks are using LLM APIs today.

Are folks doing anything bespoke, unique or different?

I think we've seen a lot of usage with harnesses, CLIs, Cursor/Windsurf etc which uses the APIs underneath.

If you are using the API itself, what does your architecture look like with said API?

4 points | by Mnexium 2 hours ago

4 comments

  • late_night_fix 1 hour ago
    I try to batch requests and reuse responses wherever possible.LLM API calls are awesome,but if you don't watch your usage,cost sneaks up fast.
    [-]
    • Mnexium 1 hour ago
      Agreed, are you doing anything to take advantage of cacheing?

      Anything else you can share about project?

  • LogicCraft678 1 hour ago
    Mostly multi-model routing and structured outputs
  • 3vo-ai 26 minutes ago
    [flagged]
  • srbsa 36 minutes ago
    [dead]