🎭 Flux.2-Klein-9B-SmartCharcterswap

A specialized LoRA adapter for FLUX.2 Klein 9B designed for high-end, highly accurate character and face swapping. It excels at handling complex occlusions (like hands, veils, and foreground objects) and seamlessly matching the color grading and lighting of the target image.

Built specifically for practical, high-end portrait editing and commercial imaging workflows, ensuring photorealistic results without unwanted cartoon or stylized aesthetics.

🔴 TUTORIALS COMING SOON — SUBSCRIBE NOW

I'll be dropping in-depth tutorials on AI models, ComfyUI workflows, image & video generation, 3D tools and more.

@JettHuangAI — Hit 🔔 so you don't miss it!

☕ Support My Work

If this LoRA helps your projects, please consider supporting continued development and new model releases.

→ paypal.me/nhathoangfoto ←

Every contribution directly funds training compute, dataset curation, and the release of new open-source LoRAs.

For custom LoRA training, advanced ComfyUI workflow development, or collaboration:
🌐 Website: jetthuang.com
📱 WhatsApp: +84947397868
💬 Telegram/Discord: nhathoangfoto
🐦 X: https://x.com/NhatPhoto
📘 Facebook: https://www.facebook.com/nhathoangfoto

Powerful local hardware, ready for any complex project: 🚀 RTX 5090 | RTX Pro 6000 🛠️

🖼️ Examples

Case 1 — B&W Color Matching & Hand Occlusion

Character Source (Identity)	Target Body (Base Image)	→ Final Output

Case 2 — Complex Occlusion Handling (Veil)

Character Source (Identity)	Target Body (Base Image)	→ Final Output

Left: Character reference (identity). Middle: Target body/scene. Right: Final output — the character seamlessly integrated with perfect occlusion and lighting matching.

✨ What this LoRA does

Masterful Occlusion Handling: Unlike standard swap tools that break when hands, hair, or objects cover the face, this LoRA understands depth and seamlessly integrates the new identity behind occluding elements.
Perfect Lighting & Color Sync: Automatically adapts the source identity to the target's environment. If the target is a dramatic B&W portrait, the swapped face will perfectly match the B&W tones, contrast, and directional shadows.
Strictly High-End Realism: Finely tuned for practical photography and portrait retouching. It aggressively preserves realistic skin textures and structural anatomy while completely avoiding cartoonish or overly-smoothed AI artifacts.
Identity Preservation: Maintains the bone structure, distinct facial features, and unique characteristics of the source subject across diverse angles and expressions.

🎯 Why use it

Standard face-swap methods often fail in professional environments because they:

Paste faces over foreground objects (like hands or microphones).
Fail to adjust skin tone and lighting to match the background.
Introduce an uncanny, plastic, or illustrative look.

SmartCharcterswap LoRA solves this by acting as a highly intelligent compositor, making it an essential tool for commercial photography, automated AI photobooths, and advanced ComfyUI pipelines.

🔗 Complete Workflow

This LoRA is optimized for node-based workflows in ComfyUI, providing maximum stability and near-perfect accuracy after rigorous testing.

📋 Example Workflow

Screenshot of the highly efficient ComfyUI workflow utilized for testing and executing the Smart Character Swap.

💡 Get the Most Out of This LoRA

This LoRA performs at its absolute best when paired with a custom workflow tailored to your specific use case, combined with additional control LoRAs for precise, production-ready results.

A generic workflow will only scratch the surface of what this model can do. For commercial shoots, AI photobooths, or advanced portrait pipelines — a purpose-built workflow makes all the difference.

📩 For a custom workflow, please contact me directly:

📱 WhatsApp: +84947397868

💬 Telegram/Discord: nhathoangfoto

🌐 jetthuang.com

🎯 Trigger Word

jhuangswap

Place this trigger at the beginning of your positive prompt to activate the character swapping behavior effectively.

Example Prompt Structure

jhuangswap, masterpiece, high-end photography, realistic portrait of a young man, matching target lighting, highly detailed skin texture, 8k resolution

💡 Tips & Prompting Guide

1. Focus on Photographic Quality

To maintain the high-end practical feel, always use prompts that steer the base model toward realism.
Good: jhuangswap, editorial photography, studio lighting, raw photo, realistic skin...
Avoid: Prompts containing words like illustration, 3d render, anime, stylized...

2. Let the Target Image Dictate the Scene

You do not need to heavily describe the pose or the background if you are using an image-to-image/ControlNet workflow. Let the Target Body image drive the composition, and use the prompt to reinforce the identity and photographic quality.

3. Recommended Settings

LoRA Strength: 0.75 – 1.0 (Adjust based on how aggressively the target image deviates from the source identity).
Inference Steps: 20–30 steps for Base Model.
Guidance Scale: 2.0 – 4.0

🚀 Usage

ComfyUI

1. Download the .safetensors file.
2. Place it in: ComfyUI/models/loras/
3. Build your image-to-image or character swap workflow (refer to the Screenshot.jpg).
4. Use the trigger word "jhuangswap" in your positive prompt.

Diffusers (Python)

from diffusers import Flux2Pipeline
import torch

pipe = Flux2Pipeline.from_pretrained(
    "black-forest-labs/FLUX.2-klein-base-9B",
    torch_dtype=torch.bfloat16
).to("cuda")

pipe.load_lora_weights(
    "nhathoangfoto/Flux.2-Klein-9B-SmartCharcterswap",
    adapter_name="smartcharswap"
)
pipe.set_adapters(["smartcharswap"], adapter_weights=[0.85])

# Example usage (integration with image-to-image pipelines required for full swap functionality)

⚠️ Limitations

Extreme Angles: While highly robust, extreme profile shots (full 90-degree side profiles) may still experience slight identity degradation depending on the source image quality.
Resolution: Designed for high-end outputs; providing extremely low-resolution source images will limit the detail recovery in the final output.

📄 License

Released under Apache 2.0. You are free to use this LoRA for personal, research, and commercial purposes.

The base model (FLUX.2 Klein Base 9B) has its own license — please review the FLUX.2 Klein Base 9B license terms for base-model usage conditions.

🙏 Credits

Base Model: FLUX.2 Klein Base 9B by Black Forest Labs
Author: Jett Huang (Nhật Hoàng) — Nhật Hoàng AI / jetthuang.com
Workflow developer ComfyUI, Automation Workflow AI.

☕ Enjoying this LoRA?

Your support keeps new models coming. Even a small tip makes a real difference for independent open-source AI work.

💖 Donate via PayPal

Thank you for supporting independent AI research! 🙏

If you find this LoRA useful, please ❤️ like the model and share your creations in the Community tab!

Downloads last month: 2,473

Model tree for nhathoangfoto/Flux.2-Klein-9B-Mannequin

Base model

black-forest-labs/FLUX.2-klein-base-9B

Adapter

(64)

this model