{"id":2438,"date":"2018-04-01T00:15:41","date_gmt":"2018-03-31T22:15:41","guid":{"rendered":"http:\/\/possiblelossofprecision.net\/?p=2438"},"modified":"2021-05-15T11:46:36","modified_gmt":"2021-05-15T09:46:36","slug":"building-a-custom-fedora-image-to-run-on-google-compute-engine","status":"publish","type":"post","link":"https:\/\/possiblelossofprecision.net\/?p=2438","title":{"rendered":"Building a custom Fedora image to run on Google Compute Engine"},"content":{"rendered":"\n

Thankfully the Fedora Project<\/a> provides cloud images<\/a> that can be directly used or easily modified<\/a> to run on almost any cloud environment. Though sometimes, it can be handy to build your own image.<\/p>\n

<\/p>\n

0. Prerequisites<\/h2>\n

Fedora images in general and the cloud images especially<\/a> are built using ImageFactory<\/a> which itself uses Oz<\/a>. The latest versions can always be found on koji<\/a>. To recreate an image locally, there are a couple of tools needed:<\/p>\n

\r\ndnf install imagefactory imagefactory-plugins* pykickstart\r\n<\/pre>\n
1. Kickstart and template<\/h2>\n
To build an image with ImageFactory, you’ll need two files: a kickstart file<\/a><\/strong> and an imagefactory template<\/a><\/strong>.<\/p>\n
The kickstart files for the (official) Fedora images are part of the fedora-kickstarts<\/em> package and be installed locally with dnf<\/em><\/p>\n
\r\ndnf install fedora-kickstarts\r\n<\/pre>\n
of pulled from the fedora-kickstarts git repository at https:\/\/pagure.io\/fedora-kickstarts<\/a>.<\/p>\n
The template file is an xml decription of what to build (OS version, architecture, etc.). A sample template file can be seen below:<\/p>\n
\r\n<template>\r\n    <name>fedora-cloud-custom<\/name>\r\n    <os>\r\n        <name>Fedora<\/name>\r\n        <version>27<\/version>\r\n        <arch>x86_64<\/arch>\r\n        <install type='url'>\r\n            <url>https:\/\/dl.fedoraproject.org\/pub\/fedora\/linux\/releases\/27\/Everything\/x86_64\/os\/<\/url>\r\n        <\/install>\r\n    <\/os>\r\n<\/template>\r\n<\/pre>\n
The template file can either have an .xml<\/em> or a .tdl<\/em> extension and is usually automatically generated by the koji build deamon (see https:\/\/pagure.io\/koji\/blob\/dad74a3\/f\/builder\/kojid#_4040<\/a> and https:\/\/pagure.io\/koji\/blob\/dad74a3\/f\/builder\/kojid#_3517<\/a>)<\/p>\n
2. Modifying Oz default config<\/h2>\n
ImageFactory will create a temporary virtual machine that’s used to install Fedora into a raw disk file. Depending on the package selection you might need more<\/a> that 1GB of RAM which is the Oz default on Fedora. To modify the memory limit, change the memory<\/em> parameter in the Oz configuration file<\/p>\n
\r\n...\r\n[libvirt]\r\nuri = qemu:\/\/\/system\r\nimage_type = raw\r\n# type = kvm\r\n# bridge_name = virbr0\r\n# cpus = 1\r\nmemory = 2048\r\n<\/pre>\n
You can either use your favourite editor or run<\/p>\n
\r\nsed -i -e 's\/# memory = 1024\/memory = 2048\/' \/etc\/oz\/oz.cfg\r\n<\/pre>\n
3. Building a raw disk image<\/h2>\n
Now it’s time to build the actual image. Since the kickstart file might be hierarchical, i.e. contain %include<\/em> statements to point to user kickstart files, we need to create a ‘flat’ version first:<\/p>\n
\r\ntempfile=$(mktemp --suffix=.ks)\r\nksflatten -v F27 -c \/usr\/share\/spin-kickstarts\/fedora-cloud-base.ks > ${tempfile}\r\n<\/pre>\n
Of course, the kickstart file can be customized first.<\/p>\n
To build the image, run<\/p>\n
\r\nimagefactory base_image \\\r\n  --file-parameter install_script ${tempfile} fedora-cloud-custom.tdl \\\r\n  --parameter offline_icicle true\r\n<\/pre>\n
The offline_icicle<\/em> parameter is necessary to tell Oz that it should rather mount the disk image and chroot into it instead of spawning a temporary throwaway VM and ssh-ing into it to run RPM commands.<\/p>\n
After a short while ImageFactory will print the UUID of the created image:<\/p>\n
\r\n============ Final Image Details ============\r\nUUID: 925b9ac8-7dca-4a9f-b055-330b23e45923\r\nType: base_image\r\nImage filename: \/var\/lib\/imagefactory\/storage\/925b9ac8-7dca-4a9f-b055-330b23e45923.body\r\nImage build completed SUCCESSFULLY!\r\n<\/pre>\n
4. Creating a Google Compute Engine image<\/h2>\n
There is a GCE plugin<\/a> for ImageFactory that allows you to easily package the created raw disk image:<\/p>\n
\r\nimagefactory target_image --id <UUID> gce\r\n<\/pre>\n
Unfortunately, that plugin is not packaged for Fedora yet, so this needs to be done manually. Looking at the plugin source code<\/a>, we’ll have to reproduce what the builder_did_create_target_image<\/em> function does:<\/p>\n
\r\nqemu-img convert -O raw \\\r\n  \/var\/lib\/imagefactory\/storage\/925b9ac8-7dca-4a9f-b055-330b23e45923.body \\\r\n  \/var\/lib\/imagefactory\/storage\/80e6d1d6-0207-4831-a68f-6a1f06a6841f.body.tmp\r\ntar cfz fedora-cloud-custom.tar.gz \\\r\n  \/var\/lib\/imagefactory\/storage\/80e6d1d6-0207-4831-a68f-6a1f06a6841f.body.tmp \\\r\n  --sparse --transform=s\/.*tmp\/disk.raw\/\r\n<\/pre>\n
The resulting fedora-cloud-custom.tar.gz<\/em> tarball can then be used to create a GCE image:<\/p>\n
\r\ngsutil cp fedora-cloud-custom.tar.gz gs:\/\/<bucket>\/\r\ngcloud compute images create --source-uri gs:\/\/<bucket>\/fedora-cloud-custom.tar.gz fedora-cloud-custom\r\ngcloud compute instances create fedora --machine-type f1-micro --image fedora-cloud-custom --zone us-east1-b\r\n<\/pre>\n
Resources:
\nhttps:\/\/fedoramagazine.org\/building-fedora-rawhide-images-imagefactory\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"
Thankfully the Fedora Project provides cloud images that can be directly used or easily modified to run on almost any cloud environment. Though sometimes, it can be handy to build your own image.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[7,81],"class_list":["post-2438","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-fedora","tag-gcp"],"_links":{"self":[{"href":"https:\/\/possiblelossofprecision.net\/index.php?rest_route=\/wp\/v2\/posts\/2438","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/possiblelossofprecision.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/possiblelossofprecision.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/possiblelossofprecision.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/possiblelossofprecision.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2438"}],"version-history":[{"count":12,"href":"https:\/\/possiblelossofprecision.net\/index.php?rest_route=\/wp\/v2\/posts\/2438\/revisions"}],"predecessor-version":[{"id":2450,"href":"https:\/\/possiblelossofprecision.net\/index.php?rest_route=\/wp\/v2\/posts\/2438\/revisions\/2450"}],"wp:attachment":[{"href":"https:\/\/possiblelossofprecision.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2438"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/possiblelossofprecision.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2438"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/possiblelossofprecision.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2438"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}