{"id":1027,"date":"2019-12-12T21:04:11","date_gmt":"2019-12-12T20:04:11","guid":{"rendered":"https:\/\/blogs.gentoo.org\/mgorny\/?p=1027"},"modified":"2019-12-16T09:08:48","modified_gmt":"2019-12-16T08:08:48","slug":"a-better-ebuild-workflow-with-pure-git-and-pkgcheck","status":"publish","type":"post","link":"https:\/\/blogs.gentoo.org\/mgorny\/2019\/12\/12\/a-better-ebuild-workflow-with-pure-git-and-pkgcheck\/","title":{"rendered":"A\u00a0better ebuild workflow with pure git and\u00a0pkgcheck"},"content":{"rendered":"

Many developers today continue using repoman commit<\/kbd> as their primary way of committing to Gentoo. While this tool was quite helpful, if not indispensable in times of CVS, today it’s a burden. The workflow using a single serial tool to check your packages and commit to them is not very efficient. Not only it wastes your time and slows you down \u2014 it discourages you from splitting your changes into more atomic commits.<\/p>\n

Upon hearing the pkgcheck advocacy, many developers ask whether it can commit for you. It won’t do that, that’s not its purpose. Not only it’s waste of time to implement that \u2014 it would actually make it a worse tool. With its parallel engine pkgcheck really shines when dealing with multiple packages \u2014 forcing it to work on one package is a waste of its potential.<\/p>\n

Rather than trying to proliferate your bad<\/em> old habits, you should learn how to use git and pkgcheck efficiently. This post aims to give you a few advices.<\/p>\n

<\/p>\n

pkgcheck after committing<\/h2>\n

Repoman was built under the assumption that checks should be done prior to committing. That is understandable when you’re working on a \u2018live\u2019 repository as the ones used by CVS or Subversion. However, in case of VCS-es involving staging commits such as Git there is no real difference between checking prior to or post commit. The most efficient pkgcheck workflow is to check once all changes are committed and you are ready to push.<\/p>\n

The most recent version of pkgcheck has a command just for that:<\/p>\n

$ pkgcheck scan --commits<\/code><\/pre>\n
Yes, it’s that simple.  It checks what you’ve committed compared to origin<\/kbd> (note: you’ll need to have a correct origin<\/kbd> remote), and runs scan on all those packages.  Now, if you’re committing changes to multiple packages (which should be pretty common), the scan is run in parallel to utilize your CPU power better.<\/p>\n
You might say: but repoman ensures that my commit message is neat these days!  Guess what.  The --commits<\/kbd> option does exactly that \u2014 it raises warnings if your commit message is bad.  Admittedly, it only checks summary line at the moment but that’s something that can (and will) be improved easily.<\/p>\n
And\u00a0I’ve forgotten the\u00a0most cool thing of\u00a0all: pkgcheck also reports if\u00a0you accidentally remove the\u00a0newest ebuild with stable keywords on\u00a0given arch!<\/ins><\/p>\n
One more tip.  You can use the following option to include full live verification of URLs:<\/p>\n
$ pkgcheck scan --net --commits<\/code><\/pre>\n
Again, this is a feature missing entirely from repoman.<\/p>\n
pkgcommit to ease committing to ebuilds<\/h2>\n
While the majority of repoman’s VCS support is superficial or better implemented elsewhere, there’s one killer feature worth keeping: automatically prepending the package name to the summary line.  Since that is a really trivial thing, I’ve reimplemented it in a few lines of bash as pkgcommit<\/a>.<\/p>\n
When run in a package directory, it runs an editor with pre-filled commit message template to let you type it in, then passes it along with its own arguments to git.  Usually, I use it as (I like to be explicit about signoffs and signing, you can make .git\/config<\/kbd> take care of it):<\/p>\n
$ pkgcommit -sS .<\/code><\/pre>\n
Its extra feature is that it processes -m<\/kbd> option and lets you skip the editor for simple messages:<\/p>\n
$ pkgcommit -sS . -m 'Bump to 1.2.3'<\/code><\/pre>\n
Note that it does not<\/em> go out of its way to figure out what to commit.  You need to either stage changes yourself via git add<\/kbd>, or pass appropriate paths to the command.  What’s important is that it does not limit you to committing to one directory \u2014 you can e.g. include some profile changes easily.<\/p>\n
You’ll also need pkg<\/kbd> script from the same repository.  Or you just install the whole bundle of app-portage\/mgorny-dev-scripts<\/kbd>.<\/p>\n
Amending commits via fixups<\/h2>\n
Most of you know probably know that you can update commits via git commit --amend<\/kbd>.  However, that’s useful only for editing the most recent commit.  You can also use interactive rebase to choose specific commits for editing, and then amend them.  Yet, usually there’s a much more convenient way of doing that.<\/p>\n
In order to commit a fixup<\/em> to a particular past commit, use:<\/p>\n
$ git commit --fixup OLD_COMMIT_ID<\/code><\/pre>\n
This will create a specially titled commit that will be automatically picked up and ordered by the interactive rebase:<\/p>\n
$ git rebase -i -S origin<\/code><\/pre>\n
Again, I have a tool of greater convenience.  Frequently, I just want to update the latest commit to a particular package (directory).  git-fixup<\/a> does exactly that \u2014 it finds the identifier of the latest commit to a particular file\/directory (or the current directory when no parameter is given) and commits a fixup to that:<\/p>\n
$ git-fixup .<\/code><\/pre>\n
Note that if you try to push fixups into the repository, nothing will stop you<\/em>.  This is one of the reasons that I don’t enable signoffs and signing on all commits by default.  This way, if I forget to rebase my fixups, the git hook will reject them as lacking signoff and\/or signature.<\/p>\n
Again, it is part of app-portage\/mgorny-dev-scripts<\/kbd>.<\/p>\n
Interactive rebase to the rescue<\/h2>\n
When trivial tools are no longer sufficient, interactive rebase is probably one of the best tools for editing your commits.  Start by initiating it for all commits since the last push:<\/p>\n
$ git rebase -i -S origin<\/code><\/pre>\n
It will bring your editor with a list of all commits.  Using this list, you can do a lot: reorder commits, drop<\/kbd> them, reword<\/kbd> their commit messages, use squash<\/kbd> or fixup<\/kbd> to merge them into other commits, and finally: edit<\/kbd> them (open for amending).<\/p>\n
The interactive rebase is probably the most powerful porcelain git command.  I’ve personally found the immediate tips given by git good enough but I realize that many people find it hard nevertheless.  Since it’s not my goal here to provide detailed instructions on using git, I’m going to suggest looking online for tutorials and guides.  The Rewriting History<\/a> section of the Git Book also has a few examples.<\/p>\n
Before pushing: git log<\/h2>\n
git log<\/kbd> seems to be one of the most underappreciated pre-push tools.  However, it can be of great service to you.  When run prior to pushing, it can help you verify that what you’re pushing is actually what you’ve meant to push.<\/p>\n
$ git log --stat<\/code><\/pre>\n
will list all staged commits along with a pretty summary of affected files.  This can help you notice that you’ve forgotten to git add<\/kbd> a patch, or that you’ve accidentally committed some extraneous change, or that you’ve just mixed changes from two commits.<\/p>\n
Of course, you can go even further and take a look at the changes in patch form:<\/p>\n
$ git log -p<\/code><\/pre>\n
While I realize this is nothing new or surprising to you, sometimes it’s worthwhile to reiterate the basics in a different context to make you realize something obvious.<\/p>\n","protected":false},"excerpt":{"rendered":"
Many developers today continue using repoman commit as their primary way of committing to Gentoo. While this tool was quite helpful, if not indispensable in times of CVS, today it’s a burden. The workflow using a single serial tool to check your packages and commit to them is not very efficient. Not only it wastes your time and slows you down \u2014 it discourages you from splitting your changes into … Continue reading “A\u00a0better ebuild workflow with pure git and\u00a0pkgcheck”<\/span><\/a><\/p>\n","protected":false},"author":137,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true},"categories":[11],"tags":[13],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/blogs.gentoo.org\/mgorny\/wp-json\/wp\/v2\/posts\/1027"}],"collection":[{"href":"https:\/\/blogs.gentoo.org\/mgorny\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.gentoo.org\/mgorny\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.gentoo.org\/mgorny\/wp-json\/wp\/v2\/users\/137"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.gentoo.org\/mgorny\/wp-json\/wp\/v2\/comments?post=1027"}],"version-history":[{"count":15,"href":"https:\/\/blogs.gentoo.org\/mgorny\/wp-json\/wp\/v2\/posts\/1027\/revisions"}],"predecessor-version":[{"id":1042,"href":"https:\/\/blogs.gentoo.org\/mgorny\/wp-json\/wp\/v2\/posts\/1027\/revisions\/1042"}],"wp:attachment":[{"href":"https:\/\/blogs.gentoo.org\/mgorny\/wp-json\/wp\/v2\/media?parent=1027"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.gentoo.org\/mgorny\/wp-json\/wp\/v2\/categories?post=1027"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.gentoo.org\/mgorny\/wp-json\/wp\/v2\/tags?post=1027"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}