But AI safety has comparatively been neglected, despite warnings from industry stakeholders. Researchers in AI alignment, a field that endeavors to ensure the breakthrough technology aligns with human values, anticipate a behemoth task.found that 7% of OpenAI units and 2% of DeepMind units were dedicated to AI alignment, estimating that fewer than 100 people were working in the field across seven leading organizations.
He said Conjecture was taking a broader"agnostic" approach to achieving alignment that included building intelligent systems that conform to human commands and informing policymakers to help push for better AI regulation. Still, while there's increasing VC interest, investment in AI safety is scant compared with the cash injection into generative-AI and artificial-general-intelligence startups. Investors
Aligned AI received a $146,000 grant from Alameda Research, the now bankrupt cryptocurrency investment firm founded by Sam Bankman-Fried, who's facing criminal charges over the collapse of his crypto exchange, FTX.