Sold by: Fission Labs Inc.
FloTorch is an open source tool designed to expedite the proof of concept journey for Generative AI workloads significantly. It enables users to optimize RAG implementations through systematic experimentation and validation, ensuring secure, automated, and cost efficient deployment within their AWS infrastructure.
Sold by: Fission Labs Inc.
Overview
FloTorch is an open-source, free-to-use tool that enables users to efficiently prototype and optimize Retrieval-Augmented Generation (RAG) workloads. It provides a robust framework for:
- experimentation and performance tuning,
- allowing users to configure critical hyperparameters,
- run experiments securely within their AWS infrastructure, and
- maintain full data sovereignty.
Highlights
- Optimized Experimentation: Tunes hyperparameters and tests strategies for cost, latency, and performance optimization. Saves weeks/months of valuable time.
- LLM and Database Integration: Enhances embedding models and vector databases for improved retrieval efficiency.
- Context Management and Dashboards: Fine-tunes LLM prompts and provides dashboards for data-driven decision-making.
Details
Sold by
Categories
Delivery method
Delivery option
FloTorch Container Based Installation
Latest version
Operating system
Linux
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
This product is available free of charge. Free subscriptions have no end date and may be canceled any time.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Vendor refund policy
Not applicable as the product is free
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
FloTorch Container Based Installation
Supported services: Learn more
- HAQM ECS
Container image
Containers are lightweight, portable execution environments that wrap server application software in a filesystem that includes everything it needs to run. Container applications run on supported container runtimes and orchestration services, such as HAQM Elastic Container Service (HAQM ECS) or HAQM Elastic Kubernetes Service (HAQM EKS). Both eliminate the need for you to install and operate your own container orchestration software by managing and scheduling containers on a scalable cluster of virtual machines.
Version release notes
New Features:
- llama4 scout available for inferencing on Sagemaker
Enhancements
- Expert Evaluation now enabled post completion of atleast two experiments
- Downloaded experiment results file improved
- UI enhancements
Additional details
Usage instructions
All the installation steps for FloTorch are outlined here:
Resources
Vendor resources
Support
Vendor support
Primary Support Methods:
- GitHub Issues: a. Purpose: Bug Reports, feature requests, and discussions b. Response Time: Best-effort basis by community maintainers.
- GitHub Discussions: a. Purpose: Technical questions and community help b. Format: Q&A, troubleshooting, best practices
- Documentation: a. Location: Project Wiki and README b. Content: Setup guide, best practices, troubleshooting.
Reach out to discuss AI transformation and implementation needs: email: info@flotorch.ai
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by HAQM Web Services.
Customer reviews
No customer reviews yet
Be the first to write a review for this product.