Integration of an open source LLM security project which has a client server model. The server should be deployed in AWS with an API endpoint.
On the client side: Improve a pypi package that the user can pip install and pass their local LLM inputs to the API gateway where the server will apply certain controls and take actions.
I have a working Pypi project and needs a bit of improvement.
UI: a SaaS UI that should have the ability to create a login for each user and giving them an API key that they can use locally while using the python package.
The UI should have features to select the controls they want to apply on the requests coming to the server side API endpoint. The controls will have some configuration options that the user can input through set of fields.
I have a basic implementation working. Built using python, Django, google auth setup for user login and creating an API key.
Location: Anywhere
Posted: Sept. 16, 2024, 7:41 a.m.
Apply Now Company Website