Cryptography Will Revolutionize AI Data Privacy with Daniel Kang

Watch Episode Here

Video Description

In this episode, Nathan sits down with Daniel Kang, Assistant Professor of Computer Science at the University of Illinois. Kang has done pioneering work bringing zero knowledge cryptographic proofs to the domain of AI inference. In this episode, they chat about the cryptographic theory behind Daniel’s work, how cryptography allows us to balance the tradeoff between privacy and authenticity, and how cryptography usage is needed in a world where LLMs are increasingly embedded into our daily lives. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive

CALL FOR FEEDBACK:
To borrow from a meme… we’re in the podcast arena trying stuff. Some will work. Some won’t. But we’re always learning.

http://bit.ly/TCRFeedback

Fill out the above form to let us know how we can continue delivering great content to you or sending the feedback on your mind to tcr@turpentine.co. 

TIMESTAMPS:
(00:00) Episode Preview
(00:01:04) Nathan’s Introduction
(00:07:06) Motivation for bringing zero-knowledge proofs to AI
(00:07:53) Verifying humanness without revealing personal information
(00:10:27) Verifying model execution without revealing model details
(00:12:42) Verifying medical AI services haven't been tampered with
(00:13:51) Overview of zero-knowledge proof protocol
(00:15:09) Sponsors: Netsuite | Omneky
(00:18:54) Cryptographic hashes for commitments
(00:22:42) Assumptions underlying cryptographic hashes
(00:24:17) Hash collisions
(00:25:20) Adding entropy through salting
(00:26:24) Z case snarks and the proving process
(00:31:00) Using lookup tables for nonlinearities
(00:33:35) Floating point vs fixed point calculations
(00:34:08) Quantizing models for efficiency
(00:35:55) Using polynomials to represent arbitrary computations
(00:37:26) What are finite fields?
(00:41:23) Toxic waste for cryptographic secrecy
(00:45:51) Computational costs
(00:47:39) The experience of using a cryptography application to verify model output
(00:49:05) Verification key doesn’t reveal model weights
(00:56:36) What using crypto infrastructure in AI enables and challenges to its implementation
(01:01:26) Potential for 10-100x cost reductions
(01:04:51) Authenticating images with attested cameras
(01:11:56) How cryptography in AI could impact daily life
(01:14:25) On-device credential verification
(01:15:50) Potential for regulation of hardware authentication
(01:18:52) Upcoming work to reduce proof costs

LINKS:
Daniel's website: https://ddkang.github.io

X/TWITTER:
@daniel_d_kang (Daniel)
@labenz (Nathan)
@eriktorenberg
@CogRev_Podcast

SPONSORS: NetSuite | Omneky
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.

Music Credit: GoogleLM