跳至內容

File:Demonstration of DreamBooth AI model fine-tuning for Stable Diffusion using Jimmy Wales training data from Wikimedia Commons.png

頁面內容不支援其他語言。
這個檔案來自維基共享資源
維基百科，自由的百科全書

原始檔案 ‎（2,304 × 2,048 像素，檔案大小：5.14 MB，MIME 類型：image/png）

摘要

描述

Demonstration of the use of DreamBooth to fine-tune a text-to-image diffusion model (in this particular case, Stable Diffusion) so that it can algorithmically generate highly specialised and customised image outputs. This demonstration features six output images of Jimmy Wales, founder of Wikipedia, performing bench press exercises at a fitness gym.

Procedure/Methodology

The model checkpoint was fine-tuned in DreamBooth using 38 different free-licence images of Jimmy Wales obtained from Category:Jimmy Wales on Wikimedia Commons, using Stable Diffusion V1-5 as the base model checkpoint to be trained. Specifically, the following images were used as training data:

Using d8ahazard's DreamBooth_V2 fork of Stable Diffusion web UI created by AUTOMATIC1111, a new model based on Stable Diffusion V1-5 (sd-v1-5-pruned-emaonly.ckpt) was created with "pndm" selected as the scheduler, and the following options were chosen:

  • Initialisation text: photo of jimmywalesstare man
  • Classification text: photo of a man
  • Learning rate: 0.000005
  • Total number of classification images to use: 50
  • Training steps: 4000
  • Batch size: 1
  • Class batch size: 1
  • Seed: -1
  • Resolution: 512
  • Save a checkpoint every N steps: 500

The model was then subsequently trained using the 38 images listed earlier. The DreamBooth training process, along with the image generation process outlined later below, was performed using an NVIDIA RTX 4090; since Ada Lovelace chipsets (using compute capability 8.9, which requires CUDA 11.8) are not fully supported by the pyTorch dependency libraries currently used by Stable Diffusion, I've used a custom build of xformers, along with pyTorch cu116 and cuDNN v8.6, as a temporary workaround.

After completion of the training of the new model, a batch of 768x1024 images were generated with txt2img in Stable Diffusion, using the model checkpoint taken at 1000 training steps, and with the following prompts:

Prompt: photo of jimmywalesstare man at the (gym) performing (bench press), muscular body, athletic body, Nikon D7500, 4K, sharp focus, photorealistic high-quality, volumetric lighting, close-up, detailed face

Negative prompt: (((multiple people))), (((out of frame))), (((no face))), ((deformed hands)), extra limbs, ((ugly)), (((deformed))), ((bad anatomy)), ((mangled)), (((censored))), (blurry), (((distorted face))), mutation, amputee, hugging, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, broken body, mutated, extra hands, extra feet, extra arms, extra legs, multiple views, lowres

Settings: Steps: 100, Sampler: DPM2 a, CFG scale: 12, Size: 768x1024, Highres. fix, Upscale latent space off, Denoising strength: 0.7

The final images were taken from this generated batch.
日期
來源 自己的作品
作者 Benlisquare
授權許可
(重用此檔案)
Output images

As the creator of the output images, I release this image under the licence displayed within the template below.

Stable Diffusion AI model

The Stable Diffusion AI model is released under the CreativeML OpenRAIL-M License, which "does not impose any restrictions on reuse, distribution, commercialization, adaptation" as long as the model is not being intentionally used to cause harm to individuals, for instance, to deliberately mislead or deceive, and the authors of the AI models claim no rights over any image outputs generated, as stipulated by the license.

DreamBooth

The Stable Diffusion implementation of DreamBooth by XavierXiao, of which d8ahazard's DreamBooth_V2 fork of the Stable Diffusion web UI is based on, is licenced under the MIT License.

Training data used to create the customised model checkpoint
All 38 images used to train the model via DreamBooth were free-licence images obtained from Wikimedia Commons. For detailed licencing information, refer to the file descriptions of each individual image.

授權條款

我，本作品的著作權持有者，決定用以下授權條款發佈本作品：
w:zh:共享創意
姓名標示 相同方式分享
此檔案採用共享創意 姓名標示-相同方式分享 4.0 國際授權條款。
您可以自由：
  • 分享 – 複製、發佈和傳播本作品
  • 重新修改 – 創作演繹作品
惟需遵照下列條件：
  • 姓名標示 – 您必須指名出正確的製作者，和提供授權條款的連結，以及表示是否有對內容上做出變更。您可以用任何合理的方式來行動，但不得以任何方式表明授權條款是對您許可或是由您所使用。
  • 相同方式分享 – 如果您利用本素材進行再混合、轉換或創作，您必須基於如同原先的相同或兼容的條款，來分布您的貢獻成品。
GNU head 已授權您依據自由軟體基金會發行的無固定段落、封面文字和封底文字GNU自由文件授權條款1.2版或任意後續版本，對本檔進行複製、傳播和／或修改。該協議的副本列在GNU自由文件授權條款中。
您可以選擇您需要的授權條款。

說明

添加單行說明來描述出檔案所代表的內容

在此檔案描寫的項目

描繪內容

創作作者 Chinese (Hong Kong) (已轉換拼寫)

沒有維基數據項目的某些值

作者姓名字串 繁體中文 (已轉換拼寫)：​Benlisquare
維基媒體使用者名稱 繁體中文 (已轉換拼寫)：​Benlisquare
網址：​https://commons.wikimedia.org/wiki/User:Benlisquare

著作權狀態 繁體中文 (已轉換拼寫)

有著作權 繁體中文 (已轉換拼寫)

特許條款

GNU自由文檔許可證1.2或更高版本 繁體中文 (已轉換拼寫)

共享創意署名-相同方式共享4.0國際 Chinese (Hong Kong) (已轉換拼寫)

多媒體型式 繁體中文 (已轉換拼寫)

image/png

檔案來源 Chinese (Taiwan) (已轉換拼寫)

上傳者的原創作品 繁體中文 (已轉換拼寫)

隸屬於

人工智能生成圖像 中文 (已轉換拼寫)

類型 Chinese (Hong Kong) (已轉換拼寫)

人工智能藝術 中文 (已轉換拼寫)

檔案歷史

點選日期/時間以檢視該時間的檔案版本。

日期/時間縮⁠圖尺寸用戶備⁠註
目前2023年8月8日 (二) 10:35於 2023年8月8日 (二) 10:35 版本的縮圖2,304 × 2,048（5.14 MB）Obscure2020Optimized with OxiPNG and ZopfliPNG.
2022年11月4日 (五) 18:47於 2022年11月4日 (五) 18:47 版本的縮圖2,304 × 2,048（6.04 MB）Benlisquare{{Information |Description=Demonstration of the use of DreamBooth to fine-tune a text-to-image diffusion model (in this particular case, Stable Diffusion) so that it can algorithmically generate highly specialised and customised image outputs. This demonstration features six output images of Jimmy Wales, founder of Wikipedia, performing bench press exercises...

下列2個頁面有用到此檔案：

全域檔案使用狀況

以下其他 wiki 使用了這個檔案：

取自 "https://zh.wikipedia.org/wiki/File:Demonstration_of_DreamBooth_AI_model_fine-tuning_for_Stable_Diffusion_using_Jimmy_Wales_training_data_from_Wikimedia_Commons.png"