We ran over 600 image generations to compare AI image models
11 days ago
- #model-comparison
- #AI-image-editing
- #photography
- LateNiteSoft, with 15 years of iOS photo app experience, tested 600+ AI image generations to compare models.
- They built a credit-based billing system (CreditProxy) to fairly charge users for AI image edits.
- Tested models: OpenAI (High/Medium quality), Gemini, and Seedream, focusing on quality, prompt complexity, and pricing.
- Key findings: OpenAI excels in creative/transformative edits, Gemini in realistic edits, and Seedream is a balanced, cost-effective option.
- Notable test categories: Classic filters, style transfer, portrait effects, and generative edits.
- OpenAI's 'AI slop' can distort details; Gemini avoids edits on human faces due to bias toward realism.
- Seedream showed strong performance in Asian art styles (e.g., ukiyo-e) and low poly art.
- Proposed solution: A 'prompt classifier' to route artistic prompts to OpenAI and realistic ones to Gemini.