Job Listings

LLM inference for highly private data

Upwork

I'm looking for an AI consultant who can advise us on using cloud resources for AI inference.

Our plan was to use Azure, but then we found this issue - https://www.linkedin.com/pulse/ai-data-privacy-concern-microsoft-employees-might-review-flaherty-rexbe/

Can you find another provider or another solution that explicitly does not have the ability to store your prompt inputs?

Ideal characteristics

- fast

- supports tool use

- medium context window ~8k

- not too expensive, serverless ?

- GDPR and hipaa compliant

I'm looking for a consultant to help find a solution, this could turn into a longer term job for the right candidate.

If you want this job please explain your thought process for working this out.

Location: Anywhere

Posted: Sept. 19, 2024, 11:44 p.m.

Apply Now Company Website