DynamoFL, which offers software to bring large language models (LLMs) to enterprises and fine-tune those models on sensitive data, today announced that it raised $15.1 million in a Series A funding round co-led by Canapi Ventures and Nexus Venture Partners.
The tranche, with had participation from Formus Capital and Soma Capital, brings DynamoFL’s total raised to $19.3 million. Co-founder and CEO Vaikkunth Mugunthan says that the proceeds will be put toward expanding DynamoFL’s product offerings and growing its team of privacy researchers.
“Taken together, DynamoFL’s product offering allows enterprises to develop private and compliant LLM solutions without compromising on performance,” Mugunthan told TechCrunch in an email interview.
San Francisco-based DynamoFL was founded in 2021 by Mugunthan and Christian Lau, both graduates of MIT’s Department of Electrical Engineering and Computer Science. Mugunthan says that they were motivated to launch the company by a shared desire to address “critical” data security vulnerabilities in AI models.“Generative AI has brought to the fore new risks, including the ability for LLMs to ‘memorize’ sensitive training data and leak this data to malicious actors,” Mugunthan said. “Enterprises have been ill-equipped to address these risks, as properly addressing these LLM vulnerabilities would require recruiting teams of highly specialized privacy machine learning researchers to create a streamlined infrastructure for continuously testing their LLMs against emerging data security vulnerabilities.”
Enterprises are certainly encountering challenges — mainly compliance-related — in adopting LLMs for their purposes. Companies are worried about their confidential data ending up with developers who trained the models on user data; in recent months, major corporations including Apple, Walmart and Verizon have banned employees from using tools like OpenAI’s ChatGPT.In a recent report, Gartner identified six legal and compliance risks that organizations need to evaluate for “responsible” LLM risk, including LLMs’ potential to answer questions inaccurately (a phenomenon known as hallucination), data privacy and confidentiality and model bias (for example, when a model stereotypically associates certain genders with certain professions). The report notes that these requirements might vary depending on the state and country, complicating matters; California, for example, mandates that organizations must disclose when a customer is communicating with a bot.DynamoFL, which is deployed on a customer’s virtual private cloud or on-premises, attempts to solve for these problems in a range of ways, including with an LLM penetration testing tool that detects and documents LLM data security risks like whether an LLM has memorized or could leak sensitive data. Several studies have shown that LLMs, depending on how they’re trained and prompted, can expose personal information — an obvious anathema to large firms working with proprietary data.
In addition, DynamoFL provides an LLM development platform that incorporates techniques aimed at mitigating model data leakage risks and security vulnerabilities. Using the platform, devs can integrate various optimizations into models, also, enabling them to run on hardware-constrained environments such as mobile devices and edge servers.
These capabilities aren’t particularly unique, to be clear — at least not on their face. Startups like OctoML, Seldon and Deci provide tools to optimize AI models to run more efficiently on a variety of hardware. Others, like LlamaIndex and Contextual AI, are focused on privacy and compliance — providing privacy-preserving ways to train LLMs on first-party data.
𝗦𝗲𝗺𝗮𝘀𝗼𝗰𝗶𝗮𝗹 𝗶𝘀 𝘄𝗵𝗲𝗿𝗲 𝗿𝗲𝗮𝗹 𝗽𝗲𝗼𝗽𝗹𝗲 𝗰𝗼𝗻𝗻𝗲𝗰𝘁, 𝗴𝗿𝗼𝘄, 𝗮𝗻𝗱 𝗯𝗲𝗹𝗼𝗻𝗴. We’re more than just a social platform — from jobs and blogs to events and daily chats, we bring people and ideas together in one simple, meaningful space.