What is the number of current concurrent requests groq supports using a single API key? How will the concurrency increase when using developer or enterprise solutions?
Also, is there any way to get power estimates for a single Groq Query? Since we need to consider environmental aspects as well.
Regarding concurrency, refer to our rate limits post : https://community.sambanova.ai/t/rate-limits/321
As for power, our systems are very efficient. Take a look at our blog post here for more details on how we compare: https://sambanova.ai/blog/sn40l-chip-best-inference-solution
Thank You Sir. Is there any way we can find the energy consumed by individual chips?