grow food, not lawn.

Skip to content

dynamically register models to endpoints

Russell Ballestrini requested to merge all-the-models into main

Created by: russellballestrini

modified:   app.py

Summary by CodeRabbit

  • New Features
    • Enhanced support for multiple AI inference endpoints to improve service reliability and scalability.
    • Introduced dynamic routing that automatically selects the optimal service for consistent performance.
    • Upgraded AI interactions to deliver a smoother, more adaptable experience, ensuring responsiveness even under varying conditions.
    • Optimized overall processing for faster responses and reduced downtime.

Merge request reports

All source code donated into the public domain. All trademarks reserved, including: unturf, Remarkbox, Make Post Sell