๐Ÿ›ฐ๏ธ KAO-DIFFSAT-SD-BASE-v1

Clean Stable Diffusion Inpainting Backbone for Remote Sensing Research

๐Ÿš€ Project website: https://kaopanboonyuen.github.io/KAO/


๐Ÿ›ฐ๏ธ Visual Overview

Satellite-oriented inpainting baseline enabling structured reconstruction across diverse geospatial scenes.


๐ŸŒ Overview

KAO-DIFFSAT-SD-BASE-v1 is a cleaned and structured Stable Diffusion inpainting backbone, prepared for remote sensing adaptation and research.

This repository is designed to serve as:

  • ๐Ÿงฉ A baseline model for satellite image inpainting
  • ๐Ÿง  A foundation for fine-tuning (KAO-DiffSat)
  • ๐Ÿ”ฌ A reproducible starting point for geospatial generative AI

โš ๏ธ Important:
This repository does NOT introduce new training or optimization methods.
It is a clean, minimal, and research-ready version of the original inpainting model.


๐Ÿง  Positioning

Component Description
This Repo Clean baseline diffusion backbone
KAO-DiffSat Fine-tuned satellite adaptation (future)
KAO (Paper) Optimization-based enhancement framework

๐Ÿ—๏ธ Base Model

This model is derived from:

Original model developed by Stability AI and contributors.

๐Ÿ”น What we did

  • Removed redundant files and duplicates
  • Organized model structure for clarity
  • Ensured compatibility with Diffusers
  • Prepared for downstream fine-tuning

๐Ÿ‘‰ No modification to core weights has been introduced in this release.


๐Ÿš€ Key Features

  • ๐Ÿงผ Clean and minimal model structure
  • โšก Reduced storage footprint (no redundant weights)
  • ๐Ÿ” Fully compatible with Diffusers pipelines
  • ๐Ÿ›ฐ๏ธ Ready for remote sensing fine-tuning
  • ๐Ÿงฉ Modular design for research experiments

๐Ÿ”ฌ Results Overview

Qualitative reconstruction results using diffusion-based inpainting (baseline).

Demonstration of spatial consistency and texture recovery.


๐Ÿ›ฐ๏ธ Full Visual Examples

Example outputs across multiple scene types.


โš ๏ธ What This Model Is (and Is Not)

โœ… This model:

  • A clean baseline diffusion model
  • A directly usable inpainting backbone
  • A starting point for fine-tuning and research

โŒ This model is NOT:

  • A fine-tuned satellite model
  • The KAO method
  • An optimized or domain-adapted system

๐Ÿ‘‰ Those contributions will be introduced in future releases.


๐Ÿš€ Usage (Diffusers)

from diffusers import StableDiffusionInpaintPipeline
import torch

pipe = StableDiffusionInpaintPipeline.from_pretrained(
    "kaopanboonyuen/KAO-DIFFSAT-SD-BASE-v1",
    torch_dtype=torch.float16
).to("cuda")

prompt = "High-resolution satellite image with missing regions reconstructed realistically"

image = pipe(
    prompt=prompt,
    image=init_image,
    mask_image=mask
).images[0]

๐Ÿ›ฐ๏ธ Prompt Guide (Satellite-Oriented Usage)

To simulate remote sensing behavior, use prompts emphasizing:

  • spatial consistency
  • structural realism
  • geospatial coherence

๐Ÿ”น Example

High-resolution satellite image of urban area,
reconstruct missing regions with realistic buildings,
maintain spatial consistency and natural textures

๐Ÿงช Use Cases

  • Cloud removal (baseline)
  • Image completion
  • Pre-training for remote sensing models
  • Generative data augmentation
  • Benchmark comparison

โš ๏ธ Limitations

  • Prompt-dependent outputs
  • Not trained on real satellite datasets
  • No geospatial constraints
  • High GPU memory usage

๐Ÿ”ฎ Roadmap

  • ๐Ÿ”œ KAO-DIFFSAT-INPAINTING-v1 (fine-tuned model)
  • ๐Ÿ”œ KAO-integrated optimization
  • ๐Ÿ”œ Prompt-free inference system

๐Ÿ“š Citation

๐Ÿ”น Base Model

@misc{stabilityai2022sd2,
  title        = {Stable Diffusion v2},
  author       = {{Stability AI}},
  year         = {2022},
  howpublished = {\url{https://github.com/Stability-AI/stablediffusion}},
  note         = {Including inpainting variant}
}

๐Ÿ”ฌ Project Context

This repository is part of the broader KAO-DiffSat research direction, aiming to bridge:

Diffusion Models ร— Remote Sensing ร— Optimization


๐ŸŒ Project Page

https://kaopanboonyuen.github.io/KAO/


๐Ÿค Acknowledgements

  • Stability AI for foundational diffusion models
  • Hugging Face for open model hosting
  • Open-source community for tools and infrastructure

๐ŸŒŸ Vision

This work aims to advance:

Generative AI for Earth Observation

toward scalable and research-driven geospatial intelligence systems.


Downloads last month
39
Safetensors
Model size
0.9B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support