Commit Graph

1029 Commits

Author SHA1 Message Date
Gábor Stefanik b45e1f81ae Fix failure with --external-sources 2023-12-22 13:07:45 +01:00
Gábor Stefanik 32dc4c702b More verbose error message on HTTP errors 2023-12-22 13:07:45 +01:00
Gábor Stefanik 55d3c36e09 Move kernel-bootstrap source image out of the directory it's generated from
This way, an incomplete version of the image itself won't get included
in srcfs anymore.
2023-12-22 13:07:45 +01:00
Gábor Stefanik 3305f2a41b Use manifest to deduce pre-network sources list
No need to maintain a separate pre-network-sources file anymore,
the list is instead derived from the bootstrap manifest via the
source manifest.
2023-12-22 13:07:04 +01:00
Gábor Stefanik a68ae62f9e Download distfiles only when needed, based on manifest
Unless --external-sources is given, only download distfiles that
need to be included in srcfs. The rest will be downloaded anyway
by the bootstrap system once it gets network access.

To accomplish this, instead of searching steps for sources files,
we now parse steps/manifest. As a side effect, source_manifest.py
now outputs source files in the order they appear in the manifest.
2023-12-22 13:07:04 +01:00
Gábor Stefanik 8d193df823 Fix printed image paths for bare-metal bootstrap 2023-12-22 13:06:59 +01:00
Gábor Stefanik faad907fba Fix source_manifest.py in light of the recent refactor
There's no sysa or sysc anymore.
2023-12-22 13:06:19 +01:00
Gábor Stefanik c188185ad4 Remove residual references to sysa/sysb/sysc from rootfs.py 2023-12-22 13:06:19 +01:00
Gábor Stefanik b4d9c5e7cb Disk creation improvements
* Support specifying the size of the target disk image for qemu
* For bare metal, only pad the image to the next megabyte
* Use truncate() to extend images, instead of writing zeros (faster)
* Return None from get_disk() with nonexistent name
* Leave 1MiB on non-boot disks, or 1GiB on boot disks, unpartitioned
  (for proper 4K alignment and to help preserve the srcfs or boot
  partition creation)
* Fix qemu invocation when an external.img is not used
* Make -qr work with kernel bootstrap (will need kexec-fiwix fix)
2023-12-22 13:06:19 +01:00
Gábor Stefanik dc62d8242c Create external.img only when needed 2023-12-22 12:10:09 +01:00
Andrius Štikonas 55ad47acd7
Merge pull request #357 from Googulator/amd64-archdir-fix
AMD64 archdir fix
2023-12-19 21:11:28 +00:00
Gábor Stefanik abca1a4b15 Fix ARCH vs ARCH_DIR confusion causing amd64 breakage 2023-12-19 18:32:59 +01:00
fosslinux 545bb42ca8
Merge pull request #334 from fosslinux/simplify
Simplify + Sustainability
2023-12-15 11:54:29 +00:00
fosslinux ac4a8c7e79 Install heirloom-devtools utility files to /usr/lib
Before they were just in / for no real reason
2023-12-15 22:51:00 +11:00
fosslinux ab47483a51 Linters & CI updates 2023-12-15 21:44:43 +11:00
fosslinux ff4f97ab8f Update all checksums 2023-12-15 21:44:27 +11:00
fosslinux ee77ef837d Update docs with new changes 2023-12-15 21:43:21 +11:00
fosslinux e06a19f9e2 Create a proper Linux kernel package 2023-12-15 21:43:21 +11:00
fosslinux 05c13dd64e Modify rootfs.py infrastructure to support the new layout 2023-12-15 21:43:21 +11:00
fosslinux 6ed2e09f3a Remove the notion of "sys*"
- This idea originates from very early in the project and was, at the
  time, a very easy way to categorise things.
- Now, it doesn't really make much sense - it is fairly arbitary, often
  occuring when there is a change in kernel, but not from builder-hex0
  to fiwix, and sysb is in reality completely unnecessary.
- In short, the sys* stuff is a bit of a mess that makes the project
  more difficult to understand.
- This puts everything down into one folder and has a manifest file that
  is used to generate the build scripts on the fly rather than using
  coded scripts.
- This is created in the "seed" stage.

stage0-posix -- (calls) --> seed -- (generates) --> main steps

Alongside this change there are a variety of other smaller fixups to the
general structure of the live-bootstrap rootfs.

- Creating a rootfs has become much simpler and is defined as code in
  go.sh. The new structure, for an about-to-be booted system, is

/
-- /steps (direct copy of steps/)
-- /distfiles (direct copy of distfiles/)
-- all files from seed/*
-- all files from seed/stage0-posix/*

- There is no longer such a thing as /usr/include/musl, this didn't
  really make any sense, as musl is the final libc used. Rather, to
  separate musl and mes, we have /usr/include/mes, which is much easier
  to work with.
- This also makes mes easier to blow away later.
- A few things that weren't properly in packages have been changed;
  checksum-transcriber, simple-patch, kexec-fiwix have all been given
  fully qualified package names.
- Highly breaking change, scripts now exist in their package directory
  but NOT WITH THE packagename.sh. Rather, they use pass1.sh, pass2.sh,
  etc. This avoids manual definition of passes.
  - Ditto with patches; default directory is patches, but then any patch
    series specific to a pass are named patches-passX.
2023-12-15 21:43:19 +11:00
fosslinux 0907cfd073 Add script-generator 2023-12-15 21:41:42 +11:00
fosslinux d13320dbfa
Merge pull request #344 from fosslinux/simplify-kexec-prepare
Simplify - kexec preparations
2023-12-15 10:40:04 +00:00
fosslinux 93682cbb92 Expand kexec fiwix initramfs 2023-12-15 21:38:09 +11:00
fosslinux 08bd0ef495 Support command execution in kexec linux arg
! means execute the argument as a command
2023-12-15 21:37:27 +11:00
fosslinux cef781a9f6
Merge pull request #343 from fosslinux/coreutils-stat
Build stat for coreutils
2023-12-15 10:36:16 +00:00
fosslinux d4e0fc9911
Merge pull request #341 from fosslinux/early-tools
Early tools in subdirectories
2023-12-15 10:35:59 +00:00
fosslinux 829f18d604 Rename sysa.ext2 to fiwix.ext2 2023-12-15 21:35:12 +11:00
fosslinux a0d4598028 Move checksum-transcriber to a subdirectory 2023-12-15 21:35:12 +11:00
fosslinux ddd8c8d380 Move simple-patch into a subdirectory
Add a checksum as well.

Closes #323
2023-12-15 21:35:12 +11:00
fosslinux 341a4681f5 Give kexec-fiwix a version number 2023-12-15 21:35:12 +11:00
fosslinux 73c4985aba
Merge pull request #340 from fosslinux/kaem-improv
Kaem-era improvements
2023-12-15 10:34:55 +00:00
fosslinux acddacbe6d
Merge pull request #337 from fosslinux/tarball-unify
Use Linux headers 4.9.10
2023-12-15 10:34:41 +00:00
fosslinux bb6fda569f Build stat for coreutils as well 2023-12-05 15:53:14 +11:00
Andrius Štikonas 70b7bc7f83
Merge pull request #342 from MaxHearnden/sysa-comma 2023-11-29 22:58:05 +00:00
MaxHearnden 773cc5405c add comma to list in sysa.py 2023-11-28 22:50:47 +00:00
fosslinux fc5fc39569 Use (/usr/lib/mes, /usr/include/mes), (/usr/lib, /usr/include)
Mes is now self-contained in;
/usr/lib/mes
/usr/include/mes
/usr/lib/x86-mes

musl adheres to FHS
/usr/include
/usr/lib
2023-11-28 16:56:04 +11:00
fosslinux 1b47720cbc Use uppercase variables in kaem-era
lowercase variables are inconsistent, bring them into line with rest of
live-bootstrap
2023-11-28 16:56:04 +11:00
fosslinux f7c028b588 Nit: simple-patch line length 2023-11-28 16:40:13 +11:00
fosslinux fcaaad8105 Change linux headers to 4.9.10 instead of 5.10.41
Unifies tarball distfiles.
2023-11-28 16:35:41 +11:00
fosslinux fb408c17dd
Merge pull request #338 from MaxHearnden/openssl-1.1.1l
change openssl source in sysc/python-3.11/sources
2023-11-28 05:34:44 +00:00
MaxHearnden 9c8c262f24 change openssl source in sysc/python-3.11/sources 2023-11-28 04:54:46 +00:00
fosslinux 28461d7890 Fix handling of extract 2023-11-28 12:02:50 +11:00
fosslinux fee6175504 Nit: add set -ex to kexec-fiwix 2023-11-28 12:02:19 +11:00
Googulator ed9f268bc8 Change openssl source URL because the old one redirects to HTTPS 2023-11-28 11:41:27 +11:00
fosslinux 1aa0b2103c
Merge pull request #336 from rick-masters/fix-run-as-root
Return process from run_as_root.
2023-11-27 22:01:50 +00:00
rick-masters 4cf2b860ef Fix lint warning for unnecessary else block. 2023-11-27 14:10:37 +00:00
rick-masters 4d20284f85 Return process from run_as_root. 2023-11-27 13:55:05 +00:00
Andrius Štikonas ca2ba18b60 Build simple-patch for rather than hardcoded x86. 2023-11-24 00:58:24 +00:00
fosslinux eb6cbad712
Merge pull request #333 from fosslinux/tinycc_upgrade
Update to newer bootstrappable tcc snapshot.
2023-11-20 05:26:00 +00:00
Andrius Štikonas f98161581c Update to newer bootstrappable tcc snapshot. 2023-11-19 15:49:59 +00:00