Brief introduction to SVN
The development source code of GRAMPS is stored in the SVN repository at sourceforge . This helps synchronizing changes from various developers, tracking changes, managing releases, etc. If you are reading this, you probably want to do one of two things with SVN: either download the latest source or the development version, or else upload your changes (if you have write access to the repository) or make a patchfile (if you don't have write access).
- 1 Types of branches
- 2 Stable version
- 3 Unstable development: "trunk"
- 4 Working with development branches
- 5 Useful things to know
Types of branches
There are four kinds of branches in the Subversion Repository:
- trunk - There is only one trunk. All new feature development happens in the trunk. New releases never come from the trunk. The trunk for GRAMPS can be found here: http://svn.code.sf.net/p/gramps/code/trunk
- maintenance - There are many maintenance branches. A maintenance branch is created from the trunk when all the features for a release are complete. New features are not committed to maintenance branch. Releases only come from maintenance branches. The purpose of maintenance branches is to allow the line of code to stabilize while new features are added in trunk. Maintenance branches can be found here: http://svn.code.sf.net/p/gramps/code/branches/maintenance
- geps - These are meant for development of Gramps Enhancement Proposals. Most of the time GEPS are developed in the trunk. Occassionally a GEP will require extensive reworking or long periods when the code base is ususable. In these cases a branch in geps can be used as a temporary development area. Once the hard work is done the change should be merged into the trunk and the geps branch should be removed. greps branches should follow the naming convention gep-<###>-<descriptive text> e.g. gep-013-server. Please read the #Working with development branches section for help with managing these branches.
- sandbox - These are meant for experimentation purposes. If you want to explore some ideas or try out some changes that would break the trunk or prototype something that has not made it to a GEP you can create a sandbox branch. These should be short lived. As soon as you have finished please remove the branch. We reserve the right to remove any sandbox branch that has not been touched for 12 months. sandbox branches should use the following naming convention <username>-<descriptive text> e.g. hippy-prototype-rss-idea. Please read the #Working with development branches section for help with managing these branches.
Release tags are created in the tags directory. The first two digits of the GRAMPS version number are reserved to indicate the maintenance branch the code came from. The last digit indicates the revision from that maintenance branch. For example, 3.0.4 would indicate the 5th release from the 3.0 branch (3.0.0, 3.0.1, 3.0.2, 3.0.3, 3.0.4).
Here is a hypothetical example: Imagine that the current version of GRAMPS is 8.3.2. A new series of features has been added in trunk and are ready for release. A new maintenance branch is created from trunk named 8.4 (or possibly 9.0 depending on the nature of the new features). New features continue to be added in trunk that will not be included in the 8.4 series of releases, but will be included in the 8.5 series. Bug fixes continue to occur in the 8.4 branch until the code is deemed worthy of release. At that time, a release is tagged from the 8.4 maintenance branch and named 8.4.0. Some time after the release of 8.4.0, some bugs are found and fixed in the 8.4 maintenance branch. Those bug fixes are released as 8.4.1.
- To download the source to a /home/~user/gramps42 directory, you can use two methods to access the SVN repository:
- An http frontend to gramps SVN
- SVN access
- To upload your changes, you have to have developer access.
The second method requires that svn be installed on your system (Debian/Ubuntu:
apt-get install subversion; Fedora:
yum install subversion).
With the SVN method, type the following in the command line:
You should see the downloading progress reported in your terminal. If you would like to update your source tree after some time, execute the following command in the top directory of the gramps42 source tree:
To commit your changes, you can execute:
svn commit -m "message describing the nature of the change"
Since uploading is a potentially dangerous operation, you have to explicitly obtain write access to the SVN repository from Brian Matherly or Benny Malengier.
Unstable development: "trunk"
- Also see: Getting started with GRAMPS Trunk.
There are several versions of the gramps code in SVN. The development branch for small changes and bug fixes is gramps42 and trunk has been created for the ongoing unstable version. If this talk of branch and trunk sounds confusing you might like to read the list message explaining branch and trunk.
To checkout a copy of the possibly unstable trunk to ./trunk:
svn co https://svn.code.sf.net/p/gramps/code/trunk trunk
To checkout a copy of the last branch GRAMPS 3.4 ./gramps34:
To checkout a copy of the last branch GRAMPS 3.3 ./gramps33:
To checkout a copy of the last branch GRAMPS 3.2 ./gramps32:
To checkout a copy of the last branch GRAMPS 3.1 ./gramps31:
To checkout a copy of the older stable GRAMPS 3.0 ./gramps30:
To checkout a copy of the older stable GRAMPS 2.2 ./gramps22:
Now go into the
trunk directory and type
python setup.py build
Do not install the development version if you don't know how to version python modules. That is, do not type sudo python setup.py install.
Prepare gramps34 and before
The old versions of Gramps use autotools, so you need to run
Building with Fedora 8 - 10
These are the packages you need:
yum install intltool gnome-doc-utils gettext subversion rcs
This step appears unnecessary on windows? See Installation#Building_from_source
Run the development version
As you should not install the development version, how can you try it out? The current Python version required to run Gramps trunk is officially python2.7 as of July 2012.
Option 1: run from source repo
Here, we use the code in
trunk directory to run Gramps. This means that compiled python files will be stored there. This is not ideal, but the easiest way to develop Gramps, as changes are immediately picked up by the code.
Copy the const.py file created in build to your source directory if you want to use your source directory to work with Gramps:
cp build/lib.linux-x86_64-2.7/gramps/gen/const.py gramps/gen/const.py # note the lib.linux path may vary depending on your system e.g. it could be lib.linux-i686-2.7 python Gramps.py
That is it. If you installed some dependencies of Gramps in non-default positions, you need to indicate with PYTHONPATH where then can be found, and with LD_LIBRARY_PATH where link libraries can be found. Eg, if you install GTK and spell checking from source too, you will need something like:
PYTHONPATH=/usr/local/lib/python2.7/site-packages/ LD_LIBRARY_PATH=/usr/local/lib python Gramps.py
Option 2: use the build code
Here, we use the code build in
trunk/build directory to run Gramps. For compiled programs this is the only way, but for Gramps nothing is compiled. It is not bad however to keep your code separated from your execution, as deleting the build directory is easy. After a code change in your source, you then need to run however
python setup.py again to update the build direcotry. To run Gramps from build, do
cd trunk/build/lib.linux-x86_64-2.7/ python -c 'from gramps.grampsapp import main; main()'
Again, it might be needed to set with PYTHONPATH where dependencies can be found, and with LD_LIBRARY_PATH link libraries, see option 1.
If you point your PYTHONPATH to the build directory, you can actually run Gramps from a random directory. Like this:
cd PYTHONPATH=~/gramps-trunk/build/lib.linux-x86_64-2.7/ python -c 'from gramps.grampsapp import main; main()'
So, more general:
cd PYTHONPATH=~/gramps-trunk/build/lib.linux-x86_64-2.7/:/usr/local/lib/python2.7/site-packages/ LD_LIBRARY_PATH=/usr/local/lib python -c 'from gramps.grampsapp import main; main()'
If the build directory is in your PYTHONPATH, you can also just execute the grampsapp.py module. So this will work too:
cd ~/gramps-trunk/build/lib.linux-x86_64-2.7/gramps PYTHONPATH=~/gramps-trunk/build/lib.linux-x86_64-2.7/ python grampsapp.py
or again more generally
PYTHONPATH=~/gramps-trunk/build/lib.linux-x86_64-2.7/:/usr/local/lib/python2.7/site-packages/ LD_LIBRARY_PATH=/usr/local/lib python grampsapp.py
Note: at the time of writing, only the last, so using grampsapp.py works, as not all imports in Gramps have been converted to relative or absolute imports. This conversion will be finished by end of 2012 however.
Where for bugs?
The bug tracker has in the right top angle different projects. Choose project trunk and submit an issue.
Making a patchfile
If you do not have write access to the repository, you can make a patchfile with your changes. This is a text file which can then be sent by email to somebody, or posted/uploaded to the bug tracker (against a bug you are fixing or a feature request which you are solving for instance), etc.
These instructions assume SVN is installed on your system (Debian/Ubuntu:
apt-get install subversion; Fedora:
yum install subversion).
These instructions tell how to make a patchfile against trunk, so that your changes are added to the next major release of Gramps. (To make a patchfile against a branch the process is similar, with some slight changes.)
So first checkout a copy of the trunk to ./trunk:
svn co https://svn.code.sf.net/p/gramps/code/trunk trunk
Then use your favorite editor to change whatever file(s) you want.
To then use SVN to make a patchfile, first go to the top of your changed tree
and then tell SVN to record/document/itemize the changes to your edited file(s)
svn diff > ~/some-descriptive-name.patch
with the resulting file being the patchfile you just made.
If you want to add a new text file, such as a new python module, you can include that in your patchfile by first doing, e.g.,
svn add dir1/dir2/newfile.py
before you do the "svn diff" as described above. (This method does not work for non-text files such as image files; be warned.)
Note also that if you add a file in this manner, depending on what was added and where it was added, you may also have to modify the corresponding Makefile.am file.
I do not know how to make a patchfile which documents a deleted file which "patch" will then correctly delete. (If you know how, please add it here.) When SVN version 1.7 is released (scheduled for 1Q2011 as I write this), then there will be a "svn patch" command which should do that.
Working with development branches
If you are using a geps or sandbox branch you need to take care when merging changes from the trunk and back to the trunk. Please take a few minutes to read the Basic Merging section of the Subversion book.
IMPORTANT: please use an svn client that is version 1.5 or newer. The merge tracking functionality only became available in 1.5. If you use an earlier client you will have to deal with all the revision tracking of merges by hand - not fun.
IMPORTANT: if you see a message that talks about from foreign repository it is probably because your working copy was checked out from an http:// url but you are merging from a https:// url or visa versa. Just be consistent about why you use. Don't merge from foreign repository because svn will not be able to manage the revisions correctly.
Here is a quick crib sheet:
Creating a branch
To create a branch from the trunk:
svn copy https://svn.code.sf.net/p/gramps/code/trunk https://svn.code.sf.net/p/gramps/code/branches/geps/gep-014-fab-feature
Merging trunk changes into the branch
You should do this regularly so that you don't have a nasty job of resolving loads of conflicts when you come to merge your changes back into the trunk:
cd gep-014-fab-feature svn merge https://svn.code.sf.net/p/gramps/code/trunk
NOTE you will see some modification to files that you are not expecting. If you look at these you will find that they are modifications to svn properties. These are used by the merging tool to keep track of what changes have already been applied.
Merging changes from the branch back into the trunk
When you are ready to merge your changes back into the trunk:
First make sure you have all the trunk changes in your branch:
cd gep-014-fab-feature svn merge https://svn.code.sf.net/p/gramps/code/trunk svn commit -m "meaningful message"
Then move over to a working copy of the trunk and merge in your branch:
cd trunk svn merge --reintegrate https://svn.code.sf.net/p/gramps/code/branches/geps/gep-014-fab-feature
Now build it, test it, convince yourself that it all works and then commit the changes:
svn commit -m "All the changes for GEP-014"
Now you must delete your branch. You can recreate it later if you need to but svn can not cope with doing another merge --reintegrate from the same branch:
It is important that branches are removed once they have been merged into the trunk or have been abandoned. To remove a branch:
The developers reserve the right to remove branches that have been dormant for more than 1 year.
Useful things to know
svn help add
svn help commit
svn help log
Adding files to repositories requires you to set some properties to the files and to have a sourceforge account. See
svn help propset. You can use the
propget on existing files to see how you should add it. A convenient way is to common files to your
~/.subversion/config file, eg in my config I have:
[miscellany] enable-auto-props = yes [auto-props] *.py = svn:eol-style=native;svn:mime-type=text/plain;svn:keywords=Author Date Id Revision *.po = svn:eol-style=native;svn:mime-type=text/plain;svn:keywords=Author Date Id Revision *.sh = svn:eol-style=native;svn:executable Makefile = svn:eol-style=native *.png = svn:mime-type=application/octet-stream *.svg = svn:eol-style=native;svn:mime-type=text/plain
You should on creation of new directories set the svn:ignore property:
svn propedit svn:ignore src/new_dir/
and there set at least:
*.pyc *.pyo Makefile Makefile.in
The GRAMPS project does not keep a ChangeLog file under source control. All change history is captured by Subversion automatically when it is committed. A ChangeLog file is generated from the SVN commit logs before each release using svn2cl. Developers should take care to make useful commit log messages when committing changes to Subversion. Here are some guidelines:
- Try to make a descriptive message about the change.
- Use complete sentences when possible.
- When committing a change that fixes a bug on the tracker, use the bug's number and summary as the message.
- When committing a patch from a contributor, put the contributor's name and e-mail address in the commit message.
- It is not necessary to put the names of the files you have modified in the commit message because Subversion stores that automatically.
Other usage tips
- Additional tips and recommendations related to committing changes: SVN Commit Tips
- GRAMPS Committing policies
An alternative to the command line tools to view the svn repository is the online interface.
You can also download a tarball for past and present sources.