| --- |
| license: openrail |
| --- |
| |
| # 2d pixel art (beta) embedding for SD 2.0 768px |
|
|
| Hi - I am a big fan of retro/nostalgia things. |
| This is the reason why I made this embedding. |
| I have trained it on 70 images, the version I will be targeting in upcoming weeks will be based on 128 or 256 well-selected and filtered images, and processed |
| through pixelate tool to keep the same pixel size on each of the input data. This should improve the embedding dramatically. |
|
|
| **Images:** |
|
|
| <div style="display: flex; flex-direction: row; flex-wrap: wrap"> |
| <img src="https://i.imgur.com/lVqWhmx.png"> |
| </div> |
| <div style="display: flex; flex-direction: row; flex-wrap: wrap"> |
| <img src="https://i.imgur.com/eMZvUTY.png"> |
| </div> |
| <div style="display: flex; flex-direction: row; flex-wrap: wrap"> |
| <img src="https://i.imgur.com/fyGB10h.png"> |
| </div> |
| <div style="display: flex; flex-direction: row; flex-wrap: wrap"> |
| <img src="https://i.imgur.com/SJGs2nD.png"> |
| </div> |
| <div style="display: flex; flex-direction: row; flex-wrap: wrap"> |
| <img src="https://i.imgur.com/R7t1zrG.png"> |
| </div> |
| <div style="display: flex; flex-direction: row; flex-wrap: wrap"> |
| <img src="https://i.imgur.com/rLyeX7J.png"> |
| </div> |
| <div style="display: flex; flex-direction: row; flex-wrap: wrap"> |
| <img src="https://i.imgur.com/9eOUMiD.png"> |
| </div> |
| <div style="display: flex; flex-direction: row; flex-wrap: wrap"> |
| <img src="https://i.imgur.com/bfknB8t.png"> |
| </div> |
| <div style="display: flex; flex-direction: row; flex-wrap: wrap"> |
| <img src="https://i.imgur.com/3bXwXMh.png"> |
| </div> |
|
|
|
|
|
|
| ### Installation: |
|
|
| Just drop the embedding files (.pt extension) to your SD embeddings folder (`your-folder/embeddings`). |
| Restart the app if running. Use the keyword as a filename ("pixelart" for example). You can rename them as you wish. |
|
|
| Before we start: cool tool to enhance your results even further: [link](https://giventofly.github.io/pixelit/#tryit) |
|
|
| **Version of Stable Diffusion:** `2.0 - 768` |
| **Supported diffusers:** |
| - Euler a (Preffered) |
| - DDIM |
| - other (partially) |
|
|
|
|
|
|
| ### Embeddings |
|
|
| **pixelart:** |
| The most generic one. Usually gives decent pixels, reads quite well prompts, is not to "old-school". |
| Used for "pixelating process" in img2img. |
|
|
| **pixelart-soft:** |
| The softer version of an embedding. One of the most generic ones.Usually good for characters. |
|
|
| **pixelart-hard:** |
| More pixelated version of embedding. Vintage/old-school. Depends on the topic - can be colorful or very vintage/dull. |
|
|
| **pixelart-1 & pixelart-2:** |
| less generic ones. These sometimes give even better results than original (depends on topic, tags and diffuser) |
|
|
| **pixelizer:** |
| Fun but chaotic one. Good for some experiments but usually gives colorful 8-bit like pixelated platformers/game screens stuff. |
| I have left that one for experiments or as a factor for combination with other ones. |
|
|
| ### Usage |
|
|
| I highly recommend use these embeddings with `Euler a` diffuser. It will give usually best results. In some cases it would be |
| good to use negative prompts. Sometimes for testing if you caught good composition/colors - you might add or remove them |
| to impact the image. |
|
|
| **negative prompt**: |
| Recommend this negative to test stuff when you get bad results: |
| "3d, 3d render, disfigured, kitsch, ugly, oversaturated, grain, low-res, Deformed, blurry, bad anatomy, |
| disfigured, poorly drawn face, mutation, mutated, extra limb, ugly, poorly drawn hands, missing limb, blurry, |
| floating limbs, disconnected limbs, malformed hands, blur, out of focus, long neck, long body, ugly, disgusting, |
| poorly drawn, childish, mutilated, mangled, old, surreal" |
|
|
| If you have too much pixelated/chaotic output - add (all or some): |
| "grid, Tetris, tetris blocks, mosaic, mosaic, pixelated, pixel art" |
|
|
| ### Img2img |
|
|
| The embeddings give you a great opportunity to change some of your works into pixel ones. |
| The best way to do it is to follow this process: |
|
|
| First get your subject. If this is a simple image as: |
| <div style="display: flex; flex-direction: row; flex-wrap: wrap"> |
| <img src="https://i.imgur.com/ks4bpSV.png"> |
| </div> |
|
|
| Here it needed just one step! |
|
|
| What I did here was to use: |
| **Positive prompt:** "game icon, raven, by pixelart, pixelated" (very important to add pixelated) |
| **Negative prompt:** none (recommended, but you can of course experiment, especially if subject needs that) |
| **Sampler:** Euler a (needed for any pixelation) |
| **steps:** 20, |
| **CFG:** 7, |
| **Denoising:** 0.58. |
| **Resolution:** 768x768. |
|
|
| The result: |
| <div style="display: flex; flex-direction: row; flex-wrap: wrap"> |
| <img src="https://i.imgur.com/wErverC.png"> |
| </div> |
|
|
| Of course, the result can be better - you can re-roll to infinity or choose better settings or different embedding than recommended pixelart (in some cases you can try others) |
|
|
| Pixelating photos/more complex images: |
| This is more tricky - but doable. As a baseline use the above settings, |
| you can experiment with higher/lower CFG or denoising. To keep likeness I don't recommend you to go over 0.6 denoising. |
| Replace the first part of the prompt with a simple description, at the end should be part: "by/in style pixelart, pixelated" |
| Probably this will take up to 2-3 rounds. When I like the output - I set it as a base for next iteration. Then I reduce denoising by 0.4 each |
| extra round. |
| Of course this is rough process - might be different based on images. |
|
|
| Here are some examples: |
|
|
| Input: |
| <div style="display: flex; flex-direction: row; flex-wrap: wrap"> |
| <img src="https://i.imgur.com/l2dGhgH.png"> |
| </div> |
|
|
| Resuts: |
| <div style="display: flex; flex-direction: row; flex-wrap: wrap"> |
| <img src="https://i.imgur.com/zsrd92w.png"> |
| </div> |
|
|
| I still investigating how to improve on the process. |