RaPD: Resolution-Agnostic Pixel Diffusion
via Semantics-Enriched Implicit Representations

Yanhao Ge1   Shanyan Guan2   Weihao Wang1,2   Ying Tai3   Mingyu You1,4

1Tongji University   2vivo Mobile Communication Co., Ltd.   3Nanjing University
4State Key Laboratory of Autonomous Intelligent Unmanned Systems;
Frontiers Science Center for Intelligent Autonomous Systems, Ministry of Education

We introduce a continuous Neural Image Field (NIF) representation and make it generation-aware through SRG and CQAR,
bridging the reconstruction–generation gap and enabling high-quality image synthesis at arbitrary resolutions.

Images generated by RaPD at multiple output resolutions. GenEval comparison across output resolutions, showing RaPD's state-of-the-art performance among the compared methods.
Left: RaPD generates high-quality images at multiple resolutions. Right: RaPD achieves state-of-the-art GenEval performance across resolutions.
0.86GenEval · 512 × 512
82.9DPG-Bench · 512 × 512
1.1BDenoiser parameters
2.13 s4096 × 4096 · B200

Abstract

Natural images are continuous, yet most generative models synthesize them on discrete grids, limiting resolution-flexible generation. Continuous neural fields enable resolution-free rendering, but prior methods introduce continuity only at the decoding stage as an interpolation module, leaving the generative latent space discretized and reconstruction-oriented. We propose RaPD (Resolution-agnostic Pixel Diffusion), which performs diffusion in a continuous Neural Image Field (NIF) latent space. RaPD bridges this reconstruction–generation gap with Semantic Representation Guidance for generation-aware latent learning and a Coordinate-Queried Attention Renderer for coordinate-conditioned, scale-aware rendering. A single denoised latent can be rendered at arbitrary resolutions by changing only the query coordinates, keeping diffusion cost fixed. Experiments demonstrate superior generation quality and resolution scalability.

Motivation: Can one generated representation support different output resolutions?

Both VAE latents and pixel tokens use discrete grids, requiring more denoising tokens and computation at higher output resolutions. RaPD generates one continuous Neural Image Field (NIF) and renders it at different resolutions by changing the query coordinates, keeping diffusion cost fixed.

Left to right: (a) VAE latent on a coarse downsampled grid; (b) Pixel tokens on a fine discrete grid; (c) Continuous NIF (Ours), a smooth image field queried at arbitrary spatial coordinates.
From discrete VAE latents and pixel tokens to a continuous Neural Image Field, queried at arbitrary spatial coordinates.

The reconstruction–generation gap

However, the continuous NIF representations learned for reconstruction are not automatically generation-ready. Reconstruction-trained LIIF and CLIF latents can preserve low-level texture while lacking the semantic structure needed by a diffusion model.

The reconstruction–generation gap in existing Neural Image Field representations.
The reconstruction–generation gap in existing Neural Image Field representations.

Method: RaPD makes NIF generation-ready with SRG and CQAR

Stage 1: semantically guided multi-resolution NIF learning. Stage 2: text-conditioned flow matching. Inference: query one denoised latent at arbitrary resolutions.
Stage 1: semantically guided multi-resolution NIF learning. Stage 2: text-conditioned flow matching. Inference: query one denoised latent at arbitrary resolutions.

01 / Semantic Representation Guidance

Semantic Distillation

In Stage 1, pooled and projected NIF features learn from a frozen DINOv2 teacher. The distillation loss aligns features at each spatial position and preserves pairwise similarity relationships, while leaving the original latent layout unchanged.

ℒdistill = ℒmcos + ℒmdms

ℒmcos aligns local features using a cosine-similarity margin; ℒmdms aligns pairwise similarity matrices using a distance margin.

Latent-Density-Aware Timestep Shift

In Stage 2, timestep shifting adapts flow-matching training to the dense NIF latent. A larger shift factor emphasizes noisier states; RaPD uses s = 32.

t₀ = sigmoid(ξ),   ξ ∼ 𝒩(0, 1)
t = t₀ / [t₀ + (1 − t₀)s],   s = 32

02 / Coordinate-based rendering

Render beyond a fixed grid

CQAR is a coordinate-conditioned, scale-aware renderer. It uses attention to support interaction between output tokens. Changing the query coordinate grid changes the output resolution without rerunning diffusion.

Decoder comparison: LIIF uses a per-pixel MLP; CLIF uses a shallow CNN; CQAR introduces coordinate-conditioned attention.
Decoder comparison: LIIF uses a per-pixel MLP; CLIF uses a shallow CNN; CQAR introduces coordinate-conditioned attention.

Generation results

Text-to-image evaluation at 512 × 512. Higher scores are better.

GenEval

MethodParamsSingleTwoCountingColorsPositionColor attr.Overall
LDM1.4B0.920.290.230.700.020.050.37
SD38B0.980.840.660.740.400.430.68
FLUX.1-dev12B0.990.810.790.740.200.470.67
SANA1.6B0.990.790.630.880.180.470.66
PixelFlow-XL/40.9B------------0.60
PixNerd-XXL/161.2B0.970.860.440.830.710.530.73
DeCo-XXL/161.1B1.000.920.720.910.800.790.86
PixelGen-XXL/161.1B0.990.880.590.900.700.700.79
PixNerd-XXL/16 (‡)1.2B0.980.820.430.810.660.550.71
DeCo-XXL/16 (‡)1.1B0.990.920.650.910.710.770.83
PixelGen-XXL/16 (‡)1.1B0.990.880.580.910.700.670.79
RaPD1.1B0.990.930.720.930.770.740.85
RaPD (256→512)1.1B0.990.930.770.920.790.780.86

DPG-Bench

MethodParamsGlobalEntityAttributeRelationOtherAverage
SD v20.9B77.778.174.980.780.768.1
PixArt-α0.6B75.079.378.682.677.071.1
SANA1.6B90.391.289.088.992.085.5
PixelFlow-XL/40.9B----------77.9
PixNerd-XXL/161.2B80.587.987.291.372.880.9
DeCo-XXL/161.1B----------81.4
PixNerd-XXL/16 (‡)1.2B87.287.188.987.189.881.5
PixelGen-XXL/16 (‡)1.1B81.488.886.788.988.980.4
DeCo-XXL/16 (‡)1.1B88.688.488.987.686.081.2
RaPD1.1B85.187.788.989.684.181.6
RaPD (256→512)1.1B81.389.989.788.981.282.9

‡ Officially released models evaluated with the same random seed and computing environment as RaPD. Progressive RaPD uses 256 → 512 training.

Qualitative comparison with PixelGen, DeCo, and PixNerd at 512 × 512.
Qualitative comparison with PixelGen, DeCo, and PixNerd at 512 × 512.

Beyond the training resolution

MethodParamsGenEval · 1024²DPG · 1024²GenEval · 2048²DPG · 2048²
SANA1.6B0.6684.80.7083.1
SANA-v1.51.6B0.8284.50.8083.8
FLUX.1-dev12B0.6883.10.6682.8
RaPD (256→1024)1.1B0.8580.30.8580.1

Progressive 256 → 1024 training. RaPD has the highest GenEval among these methods at both resolutions. Lower DPG scores indicate remaining room for improvement in detailed prompt adherence; 2048² is beyond the 1024² training supervision range.

Fixed diffusion cost. Flexible output size.

RaPD keeps 1,024 denoising tokens across all four output resolutions.

Method512²1024²2048²4096²
PixelGen0.19 s0.60 s4.72 s61.46 s
DeCo0.21 s0.67 s5.03 s62.72 s
RaPD0.23 s0.34 s0.68 s2.13 s

Per-image inference time on NVIDIA B200. PixelGen and DeCo use 1,024 / 4,096 / 16,384 / 65,536 tokens. Rendering still adds cost as output size grows.

Limitations & future work

Training data scale, the compact Qwen3-1.7B text encoder, and an inference stack that is not yet hardware-optimized remain limitations. Detailed prompt adherence at high resolution also has room to improve.

Future directions include larger training datasets and denoisers, editing and control, and hardware-aware inference with FlashAttention, FP8, and fused kernels.

Citation

@article{ge2026rapd,
  title={RaPD: Resolution-Agnostic Pixel Diffusion via Semantics-Enriched Implicit Representations},
  author={Ge, Yanhao and Guan, Shanyan and Wang, Weihao and Tai, Ying and You, Mingyu},
  journal={arXiv preprint arXiv:2605.15908},
  year={2026}
}