tg: make sure we're really working with commits

[topgit/pro.git] / README

=========================================
TopGit -- A different patch queue manager
=========================================


DESCRIPTION
-----------

TopGit aims to make handling of large amounts of interdependent topic
branches easier. In fact, it is designed especially for the case where
you maintain a queue of third-party patches on top of another (perhaps
Git-controlled) project and want to easily organize, maintain and submit
them -- TopGit achieves that by keeping a separate topic branch for each
patch and providing some tools to maintain the branches.


INSTALLATION
------------

See the file ``INSTALL``.


GIT REPOSITORY
--------------

The TopGit git repository can be found at <http://repo.or.cz/topgit/pro>.


RATIONALE
---------

Why not use something like StGIT or Guilt or ``rebase -i`` for maintaining
your patch queue?  The advantage of these tools is their simplicity;
they work with patch *series* and defer to the reflog facility for
version control of patches (reordering of patches is not
version-controlled at all).  But there are several disadvantages -- for
one, these tools (especially StGIT) do not actually fit well with plain
Git at all: it is basically impossible to take advantage of the index
effectively when using StGIT.  But more importantly, these tools
horribly fail in the face of a distributed environment.

TopGit has been designed around three main tenets:

        (i) TopGit is as thin a layer on top of Git as possible.  You
        still maintain your index and commit using Git; TopGit will only
        automate a few indispensable tasks.

        (ii) TopGit is anxious about *keeping* your history.  It will
        never rewrite your history, and all metadata is also tracked
        by Git, smoothly and non-obnoxiously.  It is good to have a
        *single* point when the history is cleaned up, and that is at
        the point of inclusion in the upstream project; locally, you
        can see how your patch has evolved and easily return to older
        versions.

        (iii) TopGit is specifically designed to work in a
        distributed environment.  You can have several instances of
        TopGit-aware repositories and smoothly keep them all
        up-to-date and transfer your changes between them.

As mentioned above, the main intended use-case for TopGit is tracking
third-party patches, where each patch is effectively a single topic
branch.  In order to flexibly accommodate even complex scenarios when
you track many patches where many are independent but some depend on
others, TopGit ignores the ancient Quilt heritage of patch series and
instead allows the patches to freely form graphs (DAGs just like Git
history itself, only "one level higher").  For now, you have to manually
specify which patches the current one depends on, but TopGit might help
you with that in the future in a darcs-like fashion.

A glossary plug: The union (i.e. merge) of patch dependencies is called
a *base* of the patch (topic branch).

Of course, TopGit is perhaps not the right tool for you:

        (i) TopGit is not complicated, but StGIT et al. are somewhat
        simpler, conceptually.  If you just want to make a linear
        purely-local patch queue, deferring to StGIT instead might
        make more sense.

        (ii) When using TopGit, your history can get a little hairy
        over time, especially with all the merges rippling through.
        ;-)


SYNOPSIS
--------

::

        ## Create and evolve a topic branch
        $ tg create t/gitweb/pathinfo-action
        tg: Automatically marking dependency on master
        tg: Creating t/gitweb/pathinfo-action base from master...
        $ ..hack..
        $ git commit
        $ ..fix a mistake..
        $ git commit

        ## Create another topic branch on top of the former one
        $ tg create t/gitweb/nifty-links
        tg: Automatically marking dependency on t/gitweb/pathinfo-action
        tg: Creating t/gitweb/nifty-links base from t/gitweb/pathinfo-action...
        $ ..hack..
        $ git commit

        ## Create another topic branch on top of master and submit
        ## the resulting patch upstream
        $ tg create t/revlist/author-fixed master
        tg: Creating t/revlist/author-fixed base from master...
        $ ..hack..
        $ git commit
        $ tg patch -m
        tg: Sent t/revlist/author-fixed
        From: pasky@suse.cz
        To: git@vger.kernel.org
        Cc: gitster@pobox.com
        Subject: [PATCH] Fix broken revlist --author when --fixed-string

        ## Create another topic branch depending on two others non-trivially
        $ tg create t/whatever t/revlist/author-fixed t/gitweb/nifty-links
        tg: Creating t/whatever base from t/revlist/author-fixed...
        tg: Merging t/whatever base with t/gitweb/nifty-links...
        Merge failed!
        tg: Please commit merge resolution and call: tg create
        tg: It is also safe to abort this operation using `git reset --hard`
        tg: but please remember you are on the base branch now;
        tg: you will want to switch to a different branch.
        $ ..resolve..
        $ git commit
        $ tg create
        tg: Resuming t/whatever setup...
        $ ..hack..
        $ git commit

        ## Update a single topic branch and propagate the changes to
        ## a different one
        $ git checkout t/gitweb/nifty-links
        $ ..hack..
        $ git commit
        $ git checkout t/whatever
        $ tg info
        Topic Branch: t/whatever (1 commit)
        Subject: [PATCH] Whatever patch
        Base: 3f47ebc1
        Depends: t/revlist/author-fixed t/gitweb/nifty-links
        Needs update from:
                t/gitweb/nifty-links (1 commit)
        $ tg update
        tg: Updating base with t/gitweb/nifty-links changes...
        Merge failed!
        tg: Please commit merge resolution and call `tg update` again.
        tg: It is also safe to abort this operation using `git reset --hard`,
        tg: but please remember you are on the base branch now;
        tg: you will want to switch to a different branch.
        $ ..resolve..
        $ git commit
        $ tg update
        tg: Updating t/whatever against new base...
        Merge failed!
        tg: Please resolve the merge and commit. No need to do anything else.
        tg: You can abort this operation using `git reset --hard` now
        tg: and retry this merge later using `tg update`.
        $ ..resolve..
        $ git commit

        ## Update a single topic branch and propagate the changes
        ## further through the dependency chain
        $ git checkout t/gitweb/pathinfo-action
        $ ..hack..
        $ git commit
        $ git checkout t/whatever
        $ tg info
        Topic Branch: t/whatever (1/2 commits)
        Subject: [PATCH] Whatever patch
        Base: 0ab2c9b3
        Depends: t/revlist/author-fixed t/gitweb/nifty-links
        Needs update from:
                t/gitweb/pathinfo-action (<= t/gitweb/nifty-links) (1 commit)
        $ tg update
        tg: Recursing to t/gitweb/nifty-links...
        [t/gitweb/nifty-links] tg: Updating base with t/gitweb/pathinfo-action changes...
        Merge failed!
        [t/gitweb/nifty-links] tg: Please commit merge resolution and call `tg update` again.
        [t/gitweb/nifty-links] tg: It is also safe to abort this operation using `git reset --hard`,
        [t/gitweb/nifty-links] tg: but please remember you are on the base branch now;
        [t/gitweb/nifty-links] tg: you will want to switch to a different branch.
        [t/gitweb/nifty-links] tg: You are in a subshell. If you abort the merge,
        [t/gitweb/nifty-links] tg: use `exit` to abort the recursive update altogether.
        [t/gitweb/nifty-links] $ ..resolve..
        [t/gitweb/nifty-links] $ git commit
        [t/gitweb/nifty-links] $ tg update
        [t/gitweb/nifty-links] tg: Updating t/gitweb/nifty-links against new base...
        Merge failed!
        [t/gitweb/nifty-links] tg: Please resolve the merge and commit.
        [t/gitweb/nifty-links] tg: You can abort this operation using `git reset --hard`.
        [t/gitweb/nifty-links] tg: You are in a subshell. After you either commit or abort
        [t/gitweb/nifty-links] tg: your merge, use `exit` to proceed with the recursive update.
        [t/gitweb/nifty-links] $ ..resolve..
        [t/gitweb/nifty-links] $ git commit
        [t/gitweb/nifty-links] $ exit
        tg: Updating base with t/gitweb/nifty-links changes...
        tg: Updating t/whatever against new base...

        ## Clone a TopGit-controlled repository
        $ git clone URL repo
        $ cd repo
        $ tg remote --populate origin
        ...
        $ git fetch
        $ tg update

        ## Add a TopGit remote to a repository and push to it
        $ git remote add foo URL
        $ tg remote foo
        $ tg push -r foo

        ## Update from a non-default TopGit remote
        $ git fetch foo
        $ tg -r foo summary
        $ tg -r foo update


USAGE
-----
``tg [-C <dir>] [-r <remote> | -u] [-c <name>=<val>] <subcommand> [<subcommand option/argument>...]``

        -C <dir>        Change directory to <dir> before doing anything
        -r <remote>     Pretend ``topgit.remote`` is set to <remote>
        -u              Pretend ``topgit.remote`` is not set
        -c <name=val>   Pass config option to git, may be repeated

The ``tg`` tool has several subcommands:

tg help
~~~~~~~
        Our sophisticated integrated help facility.  Mostly duplicates
        what is below::

         # to list commands:
         $ tg help
         # to get help for a particular command:
         $ tg help <command>
         # to get help for a particular command in a browser window:
         $ tg help -w <command>
         # to get help on TopGit itself
         $ tg help tg
         # to get help on TopGit itself in a browser
         $ tg help -w tg

tg create
~~~~~~~~~
        Create a new TopGit-controlled topic branch of the given name
        (required argument) and switch to it.  If no dependencies are
        specified (by extra arguments passed after the first one), the
        current branch is assumed to be the only dependency.

        By default ``tg create`` opens an editor on the new ``.topmsg`` file
        and then commits the new ``.topmsg`` and ``.topdeps`` files
        automatically with a suitable default commit message.  The commit
        message can be changed with the ``-m`` (or ``--message``) or ``-F``
        (or ``--file``) option.  The automatic commit can be suppressed by
        using the ``--no-ccmmit`` option.  Running the editor on the new
        ``.topmsg`` file can be suppressed by using ``-n`` (or ``--no-edit``)
        which also suppresses the automatic commit.  If more than one
        dependency is listed, the automatic commit will not take place until
        AFTER all the listed dependencies have been merged into a base commit
        which may require some manual merge resolutions if there are conflicts.

        Previous versions of TopGit behaved as though the ``--no-edit`` option
        was always given on the command line.

        The default behavior has been changed to promote a separation between
        commits that modify ``.topmsg`` and/or ``.topdeps`` and commits that
        modify other files.  This facilitates cleaner cherry picking and other
        patch maintenance activities.

        You should edit the patch description (contained in the ``.topmsg``
        file) as appropriate.  It will already contain some prefilled bits.
        You can set the ``topgit.to``, ``topgit.cc`` and ``topgit.bcc``
        git configuration variables (see ``man git-config``) in order to
        have ``tg create`` add these headers with the given default values
        to ``.topmsg`` before invoking the editor.

        The main task of ``tg create`` is to set up the topic branch base
        from the dependencies.  This may fail due to merge conflicts.
        In that case, after you commit the conflict resolution, you
        should call ``tg create`` again (without any arguments or with the
        single argument ``--continue``); it will then detect that you are on a
        topic branch base ref and resume the topic branch creation operation.

        In an alternative use case, if ``-r <branch>`` is given instead of a
        dependency list, the topic branch is created based on the given
        remote branch.  With just ``-r`` the remote branch name is assumed
        to be the same as the local topic branch being created.  Since no
        new commits are created in this mode (only two refs will be updated)
        the editor will never be run for this use case.

tg delete
~~~~~~~~~
        Remove a TopGit-controlled topic branch of the given name
        (required argument). Normally, this command will remove only an
        empty branch (base == head) without dependendents; use ``-f`` to
        remove a non-empty branch or a branch that is depended upon by
        another branch.

        The ``-f`` option is also useful to force removal of a branch's
        base, if you used ``git branch -D B`` to remove branch B, and then
        certain TopGit commands complain, because the base of branch B
        is still there.

        IMPORTANT: Currently, this command will *NOT* remove the branch
        from the dependency list in other branches. You need to take
        care of this *manually*.  This is even more complicated in
        combination with ``-f`` -- in that case, you need to manually
        unmerge the removed branch's changes from the branches depending
        on it.

        See also ``tg annihilate``.

        | TODO: ``-a`` to delete all empty branches, depfix, revert

tg annihilate
~~~~~~~~~~~~~
        Make a commit on the current TopGit-controlled topic branch
        that makes it equal to its base, including the presence or
        absence of .topmsg and .topdeps.  Annihilated branches are not
        displayed by ``tg summary``, so they effectively get out of your
        way.  However, the branch still exists, and ``tg push`` will
        push it (except if given the ``-a`` option).  This way, you can
        communicate that the branch is no longer wanted.

        When annihilating a branch that has dependents (i.e. branches
        that depend on it), those dependents have the dependencies of
        the branch being annihilated added to them if they do not already
        have them as dependencies.  Essentially the DAG is repaired to
        skip over the annihilated branch.

        Normally, this command will remove only an empty branch
        (base == head, except for changes to the .top* files); use
        ``-f`` to annihilate a non-empty branch.

tg depend
~~~~~~~~~
        Change the dependencies of a TopGit-controlled topic branch.
        This should have several subcommands, but only ``add`` is
        supported right now.

        The ``add`` subcommand takes an argument naming a topic branch to
        be added, adds it to ``.topdeps``, performs a commit and then
        updates your topic branch accordingly.  If you want to do other
        things related to the dependency addition, like adjusting
        ``.topmsg``, prepare them in the index before calling ``tg depend
        add``.

        You have enabled ``git rerere`` haven't you?

        | TODO: Subcommand for removing dependencies, obviously

tg files
~~~~~~~~
        List files changed by the current or specified topic branch.

        Options:
          -i            list files based on index instead of branch
          -w            list files based on working tree instead of branch

tg info
~~~~~~~
        Show summary information about the current or specified topic
        branch.

        Numbers in parenthesis after a branch name such as "(11/3 commits)"
        indicate how many commits on the branch (11) and how many of those
        are non-merge commits (3).

tg patch
~~~~~~~~
        Generate a patch from the current or specified topic branch.
        This means that the diff between the topic branch base and head
        (latest commit) is shown, appended to the description found in
        the ``.topmsg`` file.

        The patch is simply dumped to stdout.  In the future, ``tg patch``
        will be able to automatically send the patches by mail or save
        them to files. (TODO)

        Options:
          -i            base patch generation on index instead of branch
          -w            base patch generation on working tree instead of branch
          --binary      pass --binary to ``git diff-tree`` to enable generation
                        of binary patches
          --diff-opt    options after the branch name (and an optional ``--``)
                        are passed directly to ``git diff-tree``

        In order to pass a sole explicit ``-w`` through to ``git diff-tree`` it
        must be separated from the ``tg`` options by an explicit ``--``.
        Or it can be spelled as ``--ignore-all-space`` to distinguuish it from
        ``tg``'s ``-w`` option.

        If additional non-``tg`` options are passed through to
        ``git diff-tree`` (other than ``--binary`` which is fully supported)
        the resulting ``tg patch`` output may not be appliable.

tg mail
~~~~~~~
        Send a patch from the current or specified topic branch as
        email(s).

        Takes the patch given on the command line and emails it out.
        Destination addresses such as To, Cc and Bcc are taken from the
        patch header.

        Since it actually boils down to ``git send-email``, please refer
        to the documentation for that for details on how to setup email
        for git.  You can pass arbitrary options to this command through
        the ``-s`` parameter, but you must double-quote everything.  The
        ``-r`` parameter with a msgid can be used to generate in-reply-to
        and reference headers to an earlier mail.

        WARNING: be careful when using this command.  It easily sends
        out several mails.  You might want to run::

                git config sendemail.confirm always

        to let ``git send-email`` ask for confirmation before sending any
        mail.

        Options:
          -i            base patch generation on index instead of branch
          -w            base patch generation on working tree instead of branch

        | TODO: ``tg mail patchfile`` to mail an already exported patch
        | TODO: mailing patch series
        | TODO: specifying additional options and addresses on command line

tg remote
~~~~~~~~~
        Register the given remote as TopGit-controlled. This will create
        the namespace for the remote branch bases and teach ``git fetch``
        to operate on them. However, from TopGit 0.8 onwards you need to
        use ``tg push``, or ``git push --mirror``, for pushing
        TopGit-controlled branches.

        ``tg remote`` takes an optional remote name argument, and an
        optional ``--populate`` switch.  Use ``--populate`` for your
        origin-style remotes: it will seed the local topic branch system
        based on the remote topic branches.  ``--populate`` will also make
        ``tg remote`` automatically fetch the remote, and ``tg update`` look
        at branches of this remote for updates by default.

        Using ``--populate`` with a remote name causes the ``topgit.remote``
        git configuration variable to be set to the given remote name.

tg summary
~~~~~~~~~~
        Show overview of all TopGit-tracked topic branches and their
        up-to-date status.  With a branch name limit output to that branch.
        Using ``--deps-only`` or ``--rdeps`` changes the default from all
        branches to just the current ``HEAD`` branch but using ``--all`` as
        the branch name will show results for all branches instead of ``HEAD``.

                ``>``
                        marks the current topic branch

                ``0``
                        indicates that it introduces no changes of its own

                ``l``/``r``
                        indicates respectively whether it is local-only
                        or has a remote mate

                ``L``/``R``
                        indicates respectively if it is ahead or out-of-date
                        with respect to its remote mate

                ``D``
                        indicates that it is out-of-date with respect to its
                        dependencies

                ``!``
                        indicates that it has missing dependencies [even if
                        they are recursive ones]

                ``B``
                        indicates that it is out-of-date with respect to
                        its base

        This can take a long time to accurately determine all the
        relevant information about each branch; you can pass ``-t`` to get
        just a terse list of topic branch names quickly.  Alternately,
        you can pass ``--graphviz`` to get a dot-suitable output to draw a
        dependency graph between the topic branches.

        You can also use the ``--sort`` option to sort the branches using
        a topological sort.  This is especially useful if each
        TopGit-tracked topic branch depends on a single parent branch,
        since it will then print the branches in the dependency order.
        In more complex scenarios, a text graph view would be much more
        useful, but that has not yet been implemented.

        The ``--deps`` option outputs dependency information between
        branches in a machine-readable format.  Feed this to ``tsort`` to
        get the output from --sort.

        The ``--deps-only`` option outputs a sorted list of the unique branch
        names given on the command line plus all of their recursive dependents
        (subject to ``--exclude`` of course).  When ``--deps-only`` is given
        the default is to just display information for ``HEAD``, but that can
        be changed by using ``--all`` as the branch name.  Each branch name
        will appear only once in the output no matter how many times it's
        visited while tracing the dependency graph or how many branch names are
        given on the command line to process.

        The ``--rdeps`` option outputs dependency information in an indented
        text format that clearly shows all the dependencies and their
        relationships to one another.  When ``--rdeps`` is given the default is
        to just display information for ``HEAD``, but that can be changed by
        using ``--all`` as the branch name.

        With ``--exclude branch``, branch can be excluded from the output
        meaning it will be skipped and its name will be omitted from any
        dependency output.  The ``--exclude`` option may be repeated to omit
        more than one branch from the output.  Limiting the output to a single
        branch that has been excluded will result in no output at all.

        Note that the branch name can be specified as ``HEAD`` as a shortcut for
        the TopGit-controlled branch that ``HEAD`` is a symbolic ref to.

        Options:
          -i            Use TopGit metadata from the index instead of the branch
          -w            Use TopGit metadata from the working tree instead of the branch


tg checkout
~~~~~~~~~~~
        Switch to a topic branch.  You can use ``git checkout <branch>``
        to get the same effect, but this command helps you navigate
        the dependency graph, or allows you to match the topic branch
        name using a regular expression, so it can be more convenient.

        There following subcommands are available:

            ``tg checkout push``
                                Check out a branch that directly
                                depends on your current branch.

            ``tg checkout pop``
                                Check out a branch that this branch
                                directly depends on.

            ``tg checkout goto <pattern>``
                                Check out a topic branch that
                                matches ``<pattern>``.  ``<pattern>``
                                is used as a sed pattern to filter
                                all the topic branches.

            ``tg checkout next``
                                An alias for ``push``.

            ``tg checkout child``
                                An alias for ``push``.

            ``tg checkout``
                                An alias for ``push``.

            ``tg checkout prev``
                                An alias for ``pop``.

            ``tg checkout parent``
                                An alias for ``pop``.

            ``tg checkout ..``
                                An alias for ``pop``.

        If any of the above commands can find more than one possible
        branch to switch to, you will be presented with the matches
        and asked to select one of them.

        The ``<pattern>`` of ``tg checkout goto`` is optional.  If you don't
        supply it, all the available topic branches are listed and you
        can select one of them.

        Normally, the ``push`` and ``pop`` commands moves one step in
        the dependency graph of the topic branches.  The ``-a`` option
        causes them (and their aliases) to move as far as possible.
        That is, ``tg checkout push -a`` moves to a topic branch that
        depends (directly or indirectly) on the current branch and
        that no other branch depends on.  ``tg checkout pop -a``
        moves to a regular branch that the current topic branch
        depends on (directly or indirectly).  If there is more than
        one possibility, you will be prompted for your selection.

tg export
~~~~~~~~~
        Export a tidied-up history of the current topic branch and its
        dependencies, suitable for feeding upstream.  Each topic branch
        corresponds to a single commit or patch in the cleaned up
        history (corresponding basically exactly to ``tg patch`` output
        for the topic branch).

        The command has three possible outputs now -- either a Git branch
        with the collapsed history, a Git branch with a linearized
        history, or a quilt series in new directory.

        In the case where you are producing collapsed history in a new
        branch, you can use this collapsed structure either for
        providing a pull source for upstream, or for further
        linearization e.g. for creation of a quilt series using git log::

                git log --pretty=email -p --topo-order origin..exported

        To better understand the function of ``tg export``, consider this
        dependency structure::

         origin/master - t/foo/blue - t/foo/red - master
                      `- t/bar/good <,----------'
                      `- t/baz      ------------'

        (where each of the branches may have a hefty history). Then::

         master$ tg export for-linus

        will create this commit structure on the branch ``for-linus``::

         origin/master - t/foo/blue -. merge - t/foo/red -.. merge - master
                      `- t/bar/good <,-------------------'/
                      `- t/baz      ---------------------'

        In this mode, ``tg export`` works on the current topic branch, and
        can be called either without an option (in that case,
        ``--collapse`` is assumed), or with the ``--collapse`` option, and
        with one mandatory argument: the name of the branch where the
        exported result will be stored.

        When using the linearize mode::

         master$ tg export --linearize for-linus

        you get a linear history respecting the dependencies of your
        patches in a new branch ``for-linus``.  The result should be more
        or less the same as using quilt mode and then reimporting it
        into a Git branch.  (More or less because the topological order
        can usually be extended in more than one way into a total order,
        and the two methods may choose different ones.)  The result
        might be more appropriate for merging upstream, as it contains
        fewer merges.

        Note that you might get conflicts during linearization because
        the patches are reordered to get a linear history.  If linearization
        would produce conflicts then using ``--quilt`` will also likely result
        in conflicts when the exported quilt series is applied.  Since the
        ``--quilt`` mode simply runs a series of ``tg patch`` commands to
        generate the patches in the exported quilt series and those patches
        will end up being applied linearly, the same conflicts that would be
        produced by the ``--linearize`` option will then occur at that time.

        To avoid conflicts produced by ``--linearize`` (or by applying the
        ``--quilt`` output), use the default ``--collapse`` mode and then use
        ``tg rebase`` (or ``git rebase -m`` directly) on the collapsed branch
        (with a suitable <upstream>) followed by ``git format-patch`` on the
        rebased result to produce a conflict-free patch set.

        You have enabled ``git rerere`` haven't you?

        When using the quilt mode::

         master$ tg export --quilt for-linus

        would create the following directory ``for-linus``::

         for-linus/t/foo/blue.diff
         for-linus/t/foo/red.diff
         for-linus/t/bar/good.diff
         for-linus/t/baz.diff
         for-linus/series:
                t/foo/blue.diff -p1
                t/bar/good.diff -p1
                t/foo/red.diff -p1
                t/baz.diff -p1

        With ``--quilt``, you can also pass the ``-b`` parameter followed
        by a comma-separated explicit list of branches to export, or
        the ``--all`` parameter (which can be shortened to ``-a``) to
        export them all.  The ``--binary`` option enables producing Git
        binary patches.  These options are currently only supported
        with ``--quilt``.

        In ``--quilt`` mode the patches are named like the originating
        topgit branch.  So usually they end up in subdirectories of the
        output directory.  With the ``--flatten`` option the names are
        mangled so that they end up directly in the output dir (slashes
        are replaced with underscores).  With the ``--strip[=N]`` option
        the first ``N`` subdirectories (all if no ``N`` is given) get
        stripped off.  Names are always ``--strip``'d before being
        ``--flatten``'d.  With the option ``--numbered`` (which implies
        ``--flatten``) the patch names get a number as prefix to allow
        getting the order without consulting the series file, which
        eases sending out the patches.

        | TODO: Make stripping of non-essential headers configurable
        | TODO: Make stripping of [PATCH] and other prefixes configurable
        | TODO: ``--mbox`` option to export instead as an mbox file
        | TODO: support ``--all`` option in other modes of operation
        | TODO: For quilt exporting, export the linearized history created in
                a temporary branch--this would allow producing conflict-less
                series

tg import
~~~~~~~~~
        Import commits within the given revision range into TopGit,
        creating one topic branch per commit. The dependencies are set
        up to form a linear sequence starting on your current branch --
        or a branch specified by the ``-d`` parameter, if present.

        The branch names are auto-guessed from the commit messages and
        prefixed by ``t/`` by default; use ``-p <prefix>`` to specify an
        alternative prefix (even an empty one).

        Alternatively, you can use the ``-s NAME`` parameter to specify
        the name of the target branch; the command will then take one
        more argument describing a *single* commit to import.

tg update
~~~~~~~~~
        Update the current, specified or all topic branches with respect
        to changes in the branches they depend on and remote branches.
        This is performed in two phases -- first, changes within the
        dependencies are merged to the base, then the base is merged
        into the topic branch.  The output will guide you on what to do
        next in case of conflicts.

        You have enabled ``git rerere`` haven't you?

        When ``-a`` (or ``--all``) is specifed, updates all topic branches
        matched by ``<pattern>``'s (see ``git-for-each-ref(1)`` for details),
        or all if no ``<pattern>`` is given.  Any topic branches with missing
        dependencies will be skipped entirely unless ``--skip`` is specified.

        When ``--skip`` is specifed, an attempt is made to update topic
        branches with missing dependencies by skipping only the dependencies
        that are missing.  Caveat utilitor.

        After the update, if a single topic branch was specified, it is
        left as the current one; if ``-a`` was specified, it returns to
        the branch which was current at the beginning.

        If your dependencies are not up-to-date, ``tg update`` will first
        recurse into them and update them.

        If a remote branch update brings in dependencies on branches
        that are not yet instantiated locally, you can either bring in
        all the new branches from the remote using ``tg remote
        --populate``, or only pick out the missing ones using ``tg create
        -r`` (``tg summary`` will point out branches with incomplete
        dependencies by showing an ``!`` next to them).

        | TODO: ``tg update -a -c`` to autoremove (clean) up-to-date branches

tg push
~~~~~~~
        If ``-a`` or ``--all`` was specified, pushes all non-annihilated
        TopGit-controlled topic branches, to a remote repository.
        Otherwise, pushes the specified topic branches -- or the
        current branch, if you don't specify which.  By default, the
        remote gets all the dependencies (both TopGit-controlled and
        non-TopGit-controlled) and bases pushed to it too.  If
        ``--tgish-only`` was specified, only TopGit-controlled
        dependencies will be pushed, and if ``--no-deps`` was specified,
        no dependencies at all will be pushed.

        The ``--dry-run`` and ``--force`` options are passed directly to
        ``git push`` if given.

        The remote may be specified with the ``-r`` option. If no remote
        was specified, the configured default TopGit remote will be
        used.

tg base
~~~~~~~
        Prints the base commit of each of the named topic branches, or
        the current branch if no branches are named.  Prints an error
        message and exits with exit code 1 if the named branch is not
        a TopGit branch.

tg log
~~~~~~
        Prints the git log of the named topgit branch -- or the current
        branch, if you don't specify a name.

        NOTE: if you have merged changes from a different repository, this
        command might not list all interesting commits.

tg tag
~~~~~~
        Creates a TopGit annotated/signed tag or lists the reflog of one.

        A TopGit annotated tag records the current state of one or more TopGit
        branches and their dependencies and may be used to revert to the tagged
        state at any point in the future.

        When reflogs are enabled (the default in a non-bare repository) and
        combined with the ``--force`` option a single tag name may be used as a
        sort of TopGit branch state stash.  The special branch name ``--all``
        may be used to tag the state of all current TopGit branches to
        facilitate this function and has the side-effect of surpressing the
        out-of-date check allowing out-of-date branches to be included.

        As a special feature, ``--stash`` may be used as the tag name in which
        case ``--all`` is implied if no branch name is listed (instead of the
        normal default of ``HEAD``), ``--force`` and ``--no-edit`` (use
        ``--edit`` to change that) are automatically activated and the tag will
        be saved to ``refs/tgstash`` instead of ``refs/tags/<tagname>``.
        The ``--stash`` tag name may also be used with the ``-g``/``--reflog``
        option.

        A TopGit annotated/signed tag is simply a Git annotated/signed tag with
        a "TOPGIT REFS" section appended to the end of the tag message (and
        preceding the signature for signed tags).  PEM-style begin and end
        lines surround one line per ref where the format of each line is
        full-hash SP ref-name.  A line will be included for each branch given
        on the command line and each ref they depend on either directly or
        indirectly.

        If more than one TopGit branch is given on the command line, a new
        commit will be created that has an empty tree and all of the given
        TopGit branches as parents and that commit will be tagged.  If a single
        TopGit branch is given, then it will be tagged.

        All the options for creating a tag serve the same purpose as their Git
        equivalents except for two.  The ``--refs`` option suppresses tag
        creation entirely and emits the "TOPGIT REFS" section that would have
        been included with the tag.  If the ``--no-edit`` option is given and
        no message is supplied (via the ``-m`` or ``-F`` option) then the
        default message created by TopGit will be used without running the
        editor.

        With ``-g`` or ``--reflog`` show the reflog for a tag.  Unlike
        ``git log -g``, ``tg tag --reflog`` normally shows the message from the
        tag (if a tag) or the commit (if a commit) if available rather than
        the message from the reflog itself.  With ``--reflog-message`` only
        show the message (if any) from the reflog.  Non-tag entries are
        annotated with their type unless ``--no-type`` is given.  TopGit tags
        are created with a reflog if core.logallrefupdates is enabled (the
        default for non-bare repositories).  Unfortunately Git is incapable
        of showing a tag's reflog (using git log -g) as it will first resolve
        the tag before checking to see if it has a reflog.  Git can, however,
        show reflogs for lightweight tags (using git log -g) just fine but
        that's not helpful here.  Use the ``-g`` or ``--reflog`` option to see
        the reflog for an actual tag object.  This also works on non-TopGit
        annotated/signed tags as well provided they have a reflog.  The number
        of entries shown may be limited with the ``-n`` option.  If the tagname
        is omitted then ``--stash`` is assumed and ``--reflog-message`` will
        be implied (use ``--no-reflog-message`` to change that).

tg rebase
~~~~~~~~~
        Provides a ``git rebase`` rerere auto continue function.  It may be
        used as a drop-in replacement front-end for ``git rebase -m`` that
        automatically continues the rebase when ``git rerere`` information is
        sufficient to resolve all conflicts.

        You have enabled ``git rerere`` haven't you?

        If the ``-m`` or ``--merge`` option is not present then ``tg rebase``
        will complain and not do anything.

        When ``git rerere`` is enabled, previously resolved conflicts are
        remembered and can be automatically staged (see ``rerere.autoUpdate``).

        However, even with auto staging, ``git rebase`` still stops and
        requires an explicit ``git rebase --continue`` to keep going.

        In the case where ``git rebase -m`` is being used to flatten history
        (such as after a ``tg export --collapse`` prior to a
        ``git format-patch``), there's a good chance all conflicts have already
        been resolved during normal merge maintenance operations so there's no
        reason ``git rebase`` could not automatically continue, but there's no
        option to make it do so.

        The ``tg rebase`` command provides a ``git rebase --auto-continue``
        function.

        All the same rebase options can be used (they are simply passed through
        to Git unchanged).  However, the ``rerere.autoUpdate`` option is
        automatically temporarily enabled while running ``git rebase`` and
        should ``git rebase`` stop asking one to resolve and continue, but all
        conflicts have already been resolved and staged using rerere
        information, then ``git rebase --continue`` will be automatically run.

tg revert
~~~~~~~~~
        Provides the ability to revert one or more TopGit branches and their
        dependents to a previous state contained within a tag created using the
        ``tg tag`` command.  In addition to the actual revert mode operation a
        list mode operation is also provided to examine a tag's ref contents.

        The default mode (``-l`` or ``--list``) shows the state of one or more
        of the refs/branches stored in the tag data.  When no refs are given on
        the command line, all refs in the tag data are shown.  With the special
        ref name ``--heads`` then the indepedent heads contained in the tag
        data are shown.  The ``--deps`` option shows the specified refs and all
        of their dependents in single list with no duplicates.  The ``--rdeps``
        option shows a display similar to ``tg summary --rdeps`` for each ref
        or all independent heads if no ref is given on the command line.

        The revert mode has three submodes, dry-run mode (``-n`` or
        ``--dry-run``), force mode (``-f`` or ``--force``) and interactive mode
        (``-i`` or ``--interactive``).  If ``--dry-run`` (or ``-n``) is given
        no ref updates will actually be performed but what would have been
        updated is shown instead.  If ``--interactive`` (or ``-i``) is given
        then the editor is invoked on an instruction sheet allowing manual
        selection of the refs to be updated before proceeding.  Since revert is
        potentially a destructive operation, at least one of the submodes must
        be specified explicitly.  If no refs are listed on the command line
        then all refs in the tag data are reverted.  Otherwise the listed refs
        and all of their dependents (unless ``--no-deps`` is given) are
        reverted.  Unless ``--no-stash`` is given a new stash will be created
        using ``tg tag --stash`` (except, of course, in dry-run mode) just
        before actually performing the updates to facilitate recovery from
        accidents.

        Both modes accept fully-qualified (i.e. starts with ``refs/``) ref
        names as well as unqualified names (which will be assumed to be located
        under ``refs/heads/``).  In revert mode a tgish ref will always have
        both its ``refs/heads/`` and ``refs/top-bases/`` values included no
        matter how it's listed unless ``--no-deps`` is given and the ref is
        fully qualified (i.e. starts with ``refs/``) or one or the other of its
        values was removed from the instruction sheet in interactive mode.  In
        list mode a tgish ref will always have both its ``refs/heads/`` and
        ``refs/top-bases/`` values included only when using the ``--deps`` or
        ``--rdeps`` options.

        The ``--tgish-only`` option excludes non-tgish refs (i.e. refs that do
        not have a ``refs/heads/<name>``, ``refs/top-bases/<name>`` pair).

        The ``--exclude`` option (which can be repeated) excludes specific
        refs.  If the name given to ``--exclude`` is not fully-qualified (i.e.
        starts with ``refs/``) then it will exclude both members of a tgish ref
        pair.

        The ``--quiet`` (or ``-q``) option may be used in revert mode to
        suppress non-dry-run ref change status messages.

        The special tag name ``--stash`` (as well as with ``@{n}`` suffixes)
        can be used to refer to ``refs/tgstash``.

        NOTE:  If HEAD points to a ref that is updated by a revert operation
        then NO WARNING whatsoever will be issued, but the index and working
        tree will always be left completely untouched (and the reflog for
        the pointed-to ref can always be used to find the previous value).

tg prev
~~~~~~~
        Outputs the direct dependencies for the current or named branch.

        Options:
          -i            show dependencies based on index instead of branch
          -w            show dependencies based on working tree instead of branch

tg next
~~~~~~~
        Outputs all branches which directly depend on the current or
        named branch.

        Options:
          -i            show dependencies based on index instead of branch
          -w            show dependencies based on working tree instead of branch

TODO: tg rename
~~~~~~~~~~~~~~~

IMPLEMENTATION
--------------

TopGit stores all the topic branches in the regular ``refs/heads/``
namespace (so we recommend distinguishing them with the ``t/`` prefix).
Apart from that, TopGit also maintains a set of auxiliary refs in
``refs/top-*``.  Currently, only ``refs/top-bases/`` is used, containing the
current *base* of the given topic branch -- this is basically a merge of
all the branches the topic branch depends on; it is updated during ``tg
update`` and then merged to the topic branch, and it is the base of a
patch generated from the topic branch by ``tg patch``.

All the metadata is tracked within the source tree and history of the
topic branch itself, in ``.top*`` files; these files are kept isolated
within the topic branches during TopGit-controlled merges and are of
course omitted during ``tg patch``.  The state of these files in base
commits is undefined; look at them only in the topic branches
themselves.  Currently, two files are defined:

        ``.topmsg``:
            Contains the description of the topic branch in a
            mail-like format, plus the author information, whatever
            Cc headers you choose or the post-three-dashes message.
            When mailing out your patch, basically only a few extra
            mail headers are inserted and then the patch itself is
            appended.  Thus, as your patches evolve, you can record
            nuances like whether the particular patch should have
            To-list / Cc-maintainer or vice-versa and similar
            nuances, if your project is into that.  ``From`` is
            prefilled from your current ``GIT_AUTHOR_IDENT``; other
            headers can be prefilled from various optional
            ``topgit.*`` git config options.

        ``.topdeps``:
            Contains the one-per-line list of branches this branch
            depends on, pre-seeded by `tg create`. A (continuously
            updated) merge of these branches will be the *base* of
            your topic branch.

IMPORTANT: DO NOT EDIT ``.topdeps`` MANUALLY!!! If you do so, you need to
know exactly what are you doing, since this file must stay in sync with
the Git history information, otherwise very bad things will happen.

TopGit also automagically installs a bunch of custom commit-related
hooks that will verify whether you are committing the ``.top*`` files in a
sane state. It will add the hooks to separate files within the ``hooks/``
subdirectory, and merely insert calls to them to the appropriate hooks
and make them executable (but will make sure the original hook's code is
not called if the hook was not executable beforehand).

Another automagically installed piece is a ``.git/info/attributes``
specifier for an ``ours`` merge strategy for the files ``.topmsg`` and
``.topdeps``, and the (intuitive) ``ours`` merge strategy definition in
``.git/config``.


REMOTE HANDLING
---------------

There are two remaining issues with accessing topic branches in remote
repositories:

        (i) Referring to remote topic branches from your local repository
        (ii) Developing some of the remote topic branches locally

There are two somewhat contradictory design considerations here:

        (a) Hacking on multiple independent TopGit remotes in a single
            repository
        (b) Having a self-contained topic system in local refs space

To us, (a) does not appear to be very convincing, while (b) is quite
desirable for ``git-log topic`` etc. working, and increased conceptual
simplicity.

Thus, we choose to instantiate all the topic branches of given remote
locally; this is performed by ``tg remote --populate``. ``tg update``
will also check if a branch can be updated from its corresponding remote
branch.  The logic needs to be somewhat involved if we are to "do the
right thing".  First, we update the base, handling the remote branch as
if it was the first dependency; thus, conflict resolutions made in the
remote branch will be carried over to our local base automagically.
Then, the base is merged into the remote branch and the result is merged
to the local branch -- again, to carry over remote conflict resolutions.
In the future, this order might be adjustable on a per-update basis, in
case local changes happen to be diverging more than the remote ones.

All commands by default refer to the remote that ``tg remote --populate``
was called on the last time (stored in the ``topgit.remote`` git
configuration variable). You can manually run any command with a
different base remote by passing ``-r REMOTE`` *before* the subcommand
name.


REFERENCES
----------

The following references are useful to understand the development of
topgit and its subcommands.

* tg depend:
  http://lists-archives.org/git/688698-add-list-and-rm-sub-commands-to-tg-depend.html


THIRD-PARTY SOFTWARE
--------------------

The following software understands TopGit branches:

* `magit <http://magit.github.io/>`_ -- a git mode for emacs

IMPORTANT: Magit requires its topgit mode to be enabled first, as
described in its documentation, in the "Activating extensions"
subsection.  If this is not done, it will not push TopGit branches
correctly, so it's important to enable it even if you plan to mostly use
TopGit from the command line.