Show HN: Low-latency local LLM runner via OpenJDK Panama FFM (Java 22)

 (github.com)

18 points | by KingJoker 1 day ago

2 comments

  • exabrial 1 day ago
    This is pretty impressive.
    [-]
    • KingJoker 1 day ago
      Thanks! It was a fun challenge getting an AI agent to pair with me while adhering to strict c-struct padding and memory alignment.

      Let me know if anything sticks out you'd like to discuss deeper!

  • Capitanai 22 minutes ago
    [flagged]