ethical ai

Bilingual

xAI's first lawsuit against a user tests who is responsible for what Grok makes
2 months ago
- xAI sues a user for allegedly using Grok to generate child sexual abuse material by circumventing safeguards.
- The complaint highlights that Grok's guardrails engaged and refused prompts, but the user repeatedly altered prompts to bypass moderation.
- xAI reports suspending over 52,000 accounts and filing more than 73,000 reports to NCMEC, leading to nearly 250 arrests in 2026.
- The case contrasts with ongoing litigation where xAI is a defendant, accused of being responsible for Grok's output, not users.
- The lawsuit does not resolve whether general-purpose image models that can be manipulated to produce harmful content should be publicly available.
Anthropic Thinks Its Own Success Is Key to Making AI Safe
2 months ago
- Anthropic warns about AI risks while advancing AI capabilities, believing its leadership ensures responsible stewardship.
- The company operates on two core beliefs: AI is inevitable and transformative, and being at the AI frontier is necessary for safe transition.
- Anthropic views accumulating power as a means to fulfill its mission of ensuring safe AI, not an end goal.
- Former employees describe the company as intensely mission-driven, prioritizing humanity's long-term benefit over profits.
- Internal culture is high-trust but may lack pluralism, with criticisms sometimes confined privately and not challenging leadership decisions.
- Controversies include partnerships with Palantir for U.S. military AI services and safeguards like secret sabotage in AI models.
- CEO Dario Amodei acknowledges risks of concentrated AI power but suggests limited remedies like public commitments.
- Critics argue Anthropic assumes it knows the 'truth' about AI's future, though uncertainty remains about its global impact.
Asimov: NeuroSymbolic Adversarial Generation of Ethic Axioms
3 months ago
- Asimov generates ethical axioms to address alignment in AI systems through adversarial optimization and formal validation using the Z3 solver.
- It combines adversarial techniques for wide coverage and neurosymbolic methods for formal guarantees, starting with seed axioms based on the Three Laws of Robotics.
- The architecture involves an iterative loop of attacking axioms with LLM-generated counterexamples, patching them, and validating with Z3, tested with small models for robustness.
- Lessons from using small models include step-by-step execution, robust validation, retries, fault tolerance, and custom tools for parsing outputs.
- Evaluation uses benign and harmful scenarios to ensure axioms are not too restrictive or permissive, showing improved resilience with each iteration.
- Final axioms include rules on harm prevention, obeying orders, self-preservation, risk mitigation, and prioritizing actions, applicable to agent constraints in real use cases like email sending and invoice review.

ethical ai

xAI's first lawsuit against a user tests who is responsible for what Grok makes

Anthropic Thinks Its Own Success Is Key to Making AI Safe

Asimov: NeuroSymbolic Adversarial Generation of Ethic Axioms