Release plan

Revision as of 23:09, 21 August 2013 by Hooray (talk | contribs) (→‎2.12: http://www.mail-archive.com/flightgear-devel@lists.sourceforge.net/msg40609.html)
Current release: 2020.3.19 (18 Oct 2023)
Next release: 2020.3.20
See release plan for details.

This page contains details about how to release a new version of FlightGear into the wild. It is a continous work in progress to be improved with every new release.

The original plan

This release plan was originally developed by Mathias Fröhlich, Martin Spott, Thorsten Brehm and Torsten Dreyer during LinuxTag 2011.

If you think you have something to contribute to the release process, feel free to edit this page. In particular, improvements should be based on Release plan#Lessons learned from past releases. Please discuss this concept at the mailing-list.

General release concept

New FlightGear releases are scheduled twice a year. The magic number to remember is 17 (we tried 42, but that didn't turn out so well. 17 is perfect: 1 is not a prime, 7 is a prime and so is 17). On the 17th of January (1) and July (7) a new release branch is created for SimGear, FlightGear and FGDATA.

  As a clarification: We do not enter a code freeze but a feature freeze. Code changes are welcome after December 17th as long as it is guaranteed (not just "unlikely") that they do not introduce any side effects and become a release blocker. It is the sole responsibility of the commiter to decide if that is the case or not. Every new feature that didn't make it into the respository by the deadline may probably easily wait for another four weeks to get commited. Remember: most aircraft are not affected by the feature freeze and aircraft developers quickly adopt and use new features as they become available[1]
— Torsten Dreyer
 

After branching, there is one month for bug fixing in the release branch, so building and packing of the binaries and FGDATA takes place around February, 18th and August, 18th. Allowing a few days for distribution of the files, new versions should be publically available around the 20th of February and August.

The development stream of SimGear, FlightGear and FGDATA is set into a frozen state one month before the branch-day (17th), to let the dust of development settle and to allow fixing the most annoying bugs in the code. During this period, developers should not add any new features, subsystems, and the like. Immediately after the stream has branched for the release, development in the main stream (next/master) is open for major changes until one month before the next branch-day. This results in a duty cycle of 5 month developing and 1 month thinking.

Version numbers

FlightGear version numbers consist of three digits, seperated by dots:

  • Major (2.4.1): is only increased after significant changes to the functionality of the software, i.e. 1.X.X => 2.0.0 (due to switch to OSG).
  • Minor (2.4.1): has two applications:
    • Stable releases always have even numbers, i.e. 2.6.0, 2.8.0, 3.0.0.
    • The development stream (latest Git version) uses an odd number, increasing the minor number of the latest stable release's version by one. I.e., when the latest release was 2.8.0, the current development stream is 2.9.0.
  • Revision (2.4.1): is increased by bugfix releases, i.e. 2.8.1, 2.8.2, 2.8.3.

Detailed time schedule and checklist

  1. Dec/Jun 17th: Development stream is declared "frozen" or "yellow"
    1. Send a mail to the flightgear-devel mailing-list to announce the state, add a call for screenshots
    2. Create a "release preperations" topic at the forum and make it a "Global Announcement", add a call for screenshots
    3. Change the content of wiki template at Template:GitStatus to {{GitStatus:frozen}}
    4. Bump up the version-number of simgear/next, flightgear/next and fgdata/master to an even number (2.9.0 -> 3.0.0)
    5. Compile and test drive FlightGear with the new version-number
    6. Commit the new version number to next (flightgear+simgear) and master(fgdata)
    7. Tag (annotated) flightgear, simgear and fgdata with version/3.0.0
      git tag -a version/3.0.0 (Enter a wise comment)
    8. Push the branches next/master and the tags upstream
      for flightgear and simgear: git push origin next
      for fgdata: git push origin master
      for the tags (all repos): git push origin version/3.0.0
  2. Jan/Jul 17th: Create new release branch, assign new version number to dev-stream, re-open streams
    1. Pull current Git, create the release branches (for sg/fg/fgdata):
      git pull
      git branch release/3.0.0
    2. On the next/master branches, bump up the version-number of simgear, flightgear and fgdata to an odd number (3.0.0 -> 3.1.0)
    3. Compile and test drive FlightGear with the new development version number
    4. Commit the changes of version-number to next/master
    5. Tag (annotated) flightgear, simgear and fgdata with "version/2.9.0"
      git tag -a version/2.9.0 (Enter a wise comment)
    6. Push the branches next/master and release/3.0.0 and the tags upstream
      for flightgear, simgear and fgdata: git push origin release/3.0.0
      for flightgear and simgear: git push origin next
      for fgdata: git push origin master
      for the tags (all repos): git push origin version/3.1.0
    7. Declare dev-streams "open" or "green"
      Ask a wiki admin to change the content of wiki template at Template:GitStatus to {{GitStatus:open}}
      Send a mail to the flightgear-devel mailing-list to announce the state.
    8. Trigger James for the Jenkins-builds and Curt for a snapshot release and ThorstenB for the OpenSuse build
  3. Feb/Aug 1st: Start preparing the release notes and a press announcement
  4. Feb/Aug 17th: Create binaries/installers, pack fgdata, publish files, announce new version, close the release-branch.
    1. Generate latest getstart.pdf, push the PDF to fgdata/master - and cherry-pick to the release branch. Generate latest getstart HTML, push PDF and HTML to the MapServer site.
    2. Tag the release/3.00 branches of simgear, flightgear and fgdata and push the tags.
      for flighgear, simgear and fgdata: git tag version/3.0.0-final
      for flighgear, simgear and fgdata: git push origin version/3.0.0-final
    3. Merge the branch release/3.0.0 into master (NOT next) for flightgear and simgear and push the branch
      We don't have a next branch for fgdata, no merging of the release branch here.
      for flighgear and simgear:
      git checkout -b master origin/master or git checkout master if you already have the local branch
      git merge version/3.0.0-final
      git push origin master
    4. Core developers and other contributors should be invited to add their release related experiences (i.e. suggestions for improvements) to the wiki to help update and improve the release plan (i.e. this page) accordingly.

To bump up the version number

  • fgdata
    • edit the version file
  • SimGear
    • edit the version file
  • FlightGear
    • edit the version file

Definition of repository states

State Description
  Open/Green Normal development of the code base and fgdata. Unrestricted (well, sort of) access to the streams. This state lasts for five month after the release branches were created.
  Frozen/Yellow No new features or major changes shall be pushed onto the development streams (neither source nor data). This period is for preparing the code for the release and make sure there are no major issues. It lasts for four weeks until creation of the release branches.

It's a good idea for aircraft developers to adhere to this rule. However, aircraft in fgdata may be handled as an exception from the frozen state. Any change to aircraft may be pushed to the repository if it is guaranteed that this change does not affect any other aircraft or system and if no file outside the root directory of that specific aircraft is changed. Also, aircraft defined as part of the base package (e.g. the c172p) enter the frozen state and shall not undergo major changes in that period.

  Closed/Red Nothing shall be pushed to the development streams (simgear, flightgear and fgdata). This state is for creating the release branches. It lasts for just a few hours on Jan 17th and Jul 17th around 12:00 UTC.

Bug fix committing policy

Fixes for bugs during the shakedown test of the release branch may be applied to the branches next or release/2.8.0. A fix goes into release/2.8.0 if the development of next has moved forward and this fix does not apply there. It also goes into the release branch if there will be a better fix for next. A fix goes into next if it is also solves an issue for the next version. Cherry-pick this commit into the release/2.8.0 branch.

DO NOT merge next into release/2.8.0 or vice versa. Most likely, there will be commits that are not welcome in or even break the other branch.

Bug tracking

The bugtracker will be our primary source for the bug fixing period. Bugs reported on the mailing list or forum will not be tracked! Reporters shall be requested to file a bug report at the bugtracker. Bugs shall be assigned a priority and a keyword to make the assignment to a developer easier. Bug reports that can't be confirmed or need more input from the reporter to get fixed will be assigned a new state "stalled" and only processed after more information has been provided. Bugs assigned a high priority will be downgraded, if no progress has been made over a certain amount of time. This is to prevent the release from being blocked by a bug that no developer is able (or willing) to fix. The only exception is "does not compile for one of the major platforms", which certainly is a release-blocker.

Bugs that were present in the latest stable release, and now considered "fixed", should be assigned a milestone label, corresponding with the upcoming stable release number. By doing so, they'll end up in the list of fixed bugs.

Tasks and owners

The following table should be updated and augmented after each release, according to the Lessons learned section below.

Task Owner(s) Status for 2.10.0
Announce the state-change of the dev-streams TorstenD   Done
Create/maintain the git branches TorstenD   Done
Track the bugs on the tracker, trigger developers, adjust bug-priorities ThorstenB, Gijs, James, ...
Sync the language files so they can be translated ThorstenB, James   Done
Beta testing EVERYBODY
Update documentation: FAQ, The Manual, wiki Stuart, Gijs and anyone else   Done
Pack RC and final version of FGDATA
Create the RC and final version Source-tarball Curt
Linux ThorstenB (for openSUSE)
Windows Curt   Done [1]
MacOS Tat/James   Done [2]
Distribute files to download servers Curt  
Make adjustments on the web-site Collect/make screenshots for the gallery Curt
Generate aircraft page Curt, Gijs
Tag the newsletter template according to the released version

[[Category:Changes after 2.12]]

Hooray, Gijs, Stuart (other wiki admins)
Announce the new version to the public Write a changelog: Next Changelog All developers/contributors
Contact flightsim websites and send them/link them to the "press announcement". See release promotion for a list of already-contacted and yet-to-contact websites/magazins. EVERYBODY

Open items, questions

  • Automate and/or document the creation of RC's: "We need to get this automated some day. Or at least documented...(another one from "famous last words": if you have to do it more than once, automate it. If you can't automate it, document it." [3]
  • Automate the creation of Windows and Mac installers
  • Automate the creation of FGDATA distribution
  • Possibly try to find a way to automate testing of updated jsbsim code, so that the chance for breakage is reduced by running scripted tests [4] [5]

Lessons learned

This is a list of lessons learned from the previous releases, things that turned out well and should be kept for the next release as well as thing that didn't turn out so well and should be changed for future releases. Ideally, the release plan should be updated and augmented so that the lessons learned are incorporated accordingly.

2.12

Release postponed:

Due to real life constraints and the low number of active core developers, we've hit a fluctuation where pretty much everyone is occupied with something else at the moment. As everybody seems to be caught in some real life trouble, we can't see a better way to get the release out than delaying it for a while. Also, it seems that it will take longer than usual to address any issues found in the RCs. Thus, we have agreed to postpone the upcoming FlightGear 2.12 release by a month, to provide sufficient time to handle release candidates and process end-user feedback. [2]

RCs:

  • we should try to get out release candidates earlier to give testers a chance to actually run the RCs [6]
  could we generate a full installation RC package for testing? It would make it easier for testers not familiar with Git to use it, and would be quite handy for people like myself who do their development on Linux, but have Windows systems available for testing but without the git infrastructure or the time to download the entire git fgdata repository.[1]
— Stuart Buchanan
 
  Jenkins only does what it's told by the scripts (mostly in fgmeta besides the CMake files) - so we're still at the mercy of missing files in the installer description and so on - I didn't yet automate a 'smoke test'[1] on Jenkins, since that would mean keeping a clean environment to run test installs, and involve several expensive operations since we'd be launching the sim. That's all doable but requires VMs and more energy than I have. In general I've been hoping to get enough people using the nightly builds that an automated smoke-test would be unnecessary but that's probably optimistic[2]
— James Turner
 


  1. Stuart Buchanan (Wed, 21 Aug 2013 07:29:32 -0700). Re: [Flightgear-devel] 2.12 is branched.
  2. James Turner (Wed, 21 Aug 2013 07:52:59 -0700). Re: [Flightgear-devel] 2.12 is branched.

FGData:

  • Some users reported broken sound configurations for a number of aircraft due to stereo files [7]
  • We still keep seeing issues due to aircraft developers contributing resources with files, file names, paths that would break support on OS with case-sensitive OS or a different locale, it would make sense to add some form of automated/scripted validation during startup to detect such issues, without requiring a manual review, possibly through Catalog metadata [8] [9] [10]

Usability/GUI:

  • the menubar is increasingly getting a little cluttered, especially the "debug" entry - given the inflexibility of PUI, this also means that there are usability issues, because certain menu items are only accessible with a certain minimal screen resolution, other items cannot be accessed easily. A short term suggestion made, was moving all "Reload X" items into a dedicated "reload" menu, and moving tools to a separate "tools" menu, so help reduce the size of the debug menu [11] [12]


Core:

  • Like it used to be the case with detailed log files, most end users are usually very willing to help, but unable to provide backtraces - reconsider adding the google breakpad support [13]
  • under some circumsances, initial navcache/POI processing took up to 10 minutes, even on powerful Linux boxes with plenty of horsepower and RAM using just the default settings [14]
  • the way we are incrementing version numbers in SG_SRC/FG_SRC and FGDATA seems to be causing issues ("base package check failed"), which were reported already during the last release cycles (all the way back to 2.8), even one core developer reported the issue during the 2.10 cycle (many people affected by this seem to be using brisa's download & compile script, but it doesn't appear to be Linux-specific, it also seems to happen on Windows). It seems fgdata version is 2.12 while the SG/FG source trees in next were still looking for 2.11 - could be also because of cmake caching, and the cache not being updated properly once certain files are touched in SG/FG source, still investigating... [15] [16]. The problem seems to be this.
  • some rendering issues related to OSG 3.1.9 were reported [17] [18] [19] [20]
  • it would probably be a good idea to explicitly check for the latest supported OSG version in our SG/FG CMakeLists.txt, to ensure that people do not build FG against OSG versions that are not yet supported, with some option to override/disable the check (for developers) [21] [22]
  • while the delayed tile loading is a big improvement in the responsiveness, delayed loading of models caused issues for helicopter pilots, because they could no longer start on buildings - it might be better to make the new behavior property-configurable through a prop switch, so that helicopters could override the setting during startup in their aircraft-set.xml file [23]

Version numbering:

  There was already a couple of people on IRC confused that 2.12 is different to 2.1.2 (since minor version numbers > 9 are something of a rarity in many people's perception).[1]
— James Turner
 
  Give our release pattern is date scheduled, an Ubuntu style numbering scheme would actually make more sense, but a bit more effort to move too.[2]
— James Turner
 
  Externally, 3.0 is going to be considered a bigger deal than 2.12.0.[3]
— Stuart Buchanan
 
  I suggest that we zero-pad the minor release digit after 3.0.0 so we have 3.02, 3.04 etc. to reduce confusion if we reach double digits.[4]
— Stuart Buchanan
 
  many computer systems sort file names in ascii order, many people don't seem to pay careful attention to where the decimal points are placed, etc. Once we clear past the 2.10, 2.12, etc. series, I'd like to go back to keeping things single digits in the major and minor version numbers and when we run out of a single digits bump up the major number (so 3.8.x -> 4.0.x). Number are numbers, but this one confused a lot more people than I expected it would or should so maybe it's good to be sensitive to that after we clear the 2.x series of versions.[5]
— Curtis Olson
 
  That sounds OK to me, as it would imply a full release every 2.5 years, give a clear flag ahead of time when we're nearing a major release, and save having these discussions in the future. For reference, with the current plan there will be 4 years between 2.0.0 (Feb 2010) was and 3.0.0 (Feb 2014). [6]
— Stuart Buchanan
 
  I've set the version files on 'next' to be 2.99, on the assumption the next release will be 3.0 as discussed.[7]
— James Turner
 

Backwards Compatibility:

  I think I sensible step in that case is to keep 3.0 as backward compatible (in terms of Aircraft APIs) with 2.12 as possible, which mostly means my resisting the urge to clean up legacy stuff :)

Obviously it's tricky to offer a 100% guarantee, but I don't have anything planned for 3.0 that will require aircraft changes - I'm sure new technologies such as state machines, knob/slider animations and tooltips will mature and gain some new features but hopefully aircraft developers will be able to work

against 2.12 with confidence that things will work the same in 3.0[8]
— James Turner
 
  It's a bit tricky because I haven't had much feedback from aircraft developers about the new APIs (since they aren't in 2.10), but once 2.12 ships we would want to keep them compatible, so fingers crossed the current design is sensible [9]
— James Turner
 

2.10

!!! NOTE: None of these issues have been incorporated into the release plan yet !!!

  • FlightGear Core related :
    • a number of users reported segfaults related to the new flight recorder system [24] [25]
    • the download & compile script in fgmeta should be updated for each release [26]
    •   It is great news if you are able to crank out full installers right from Jenkins. That will save me a bunch of downloading and hours of uploading for every new release candidate [27].
    • But it might be a good idea to create a script that will distribute the new builds to the various mirrors. That way I'm less likely to throttle the build server to 10k/sec [28]
    • we could also automatically seed them in BitTorrent, on a Linux box and use "btmakemetafile" which I use here to generate those update packages on the tracker [29]
    • IMPROVE RELEASE PLAN: perform a sync with JSBSim sources before the feature freeze   [30].
    • IMPROVE RELEASE PLAN: decide early on if/when navdata can be updated   [31]
    • IMPROVE RELEASE PLAN: merge requests that didn't make it into the previous release should probably be handled early during the upcoming release cycle  
    • IMPROVE RELEASE PLAN: distro-specific repositories should probably be updated, too   [32]
    • IMPROVE RELEASE PLAN: the "FlightGear & friends" SuseStudio images should probably be also updated for each release cycle   [33]
    • every now and then, people raise the issue of the major/minor version numbering scheme being a little confusing to people not familiar with software development, thinking that 2.8 must be newer/better/more recent than 2.11 - using code names or release dates instead was suggested [34]
    • there are usually reviews posted on blogs, forums etc after each release - we should specifically collect links to those and evaluate all opinions [35] [36]
    • IMPROVE RELEASE PLAN: the release plan should be augmented for the sub-release procedures   [37]
    • there were a number of navcache/SQLite related issues reported via the issue tracker and the forum/devel list [38] [39] [40]
    • a little irritation/frustration was caused due to the conflicting review statements concerning the new radio propagation code [41] [42] [43] - some of this boiled down to coding style related issues, highlighting the fact that different core developers have different "coding styles" and requirements when reviewing merge requests, because we still lack an official "FlightGear coding style guide" [44]
    • according to Windows users, the installer created by jenkins could use some optimizations [45]
    • a number of Windows7/Windows8 users reported issues that needed a "force 32/64 bit" workaround during startup [46][47][48]
    • IMPROVE RELEASE PLAN: new GUI widgets, new fgcommands and new Nasal APIs should ideally be documented prior the release, at least through updated README files, preferably also through the wiki  


  • Better bug reports and troubleshooting:
    • show HLA/OpenRTI availability   Fixed since 2.11+ [49]
    • add a string property with list of startup arguments used by the user, for use in the about dialog
    • add a property specifying if the binary is 32/64 bit for use in the about dialog (to check if segfaults are related to 32bit RAM limits)
    • add a property specifying the CMAKE_BUILD_TYPE variable used during compilation, for use in the about dialog (debug, release, RelWithDbgInfo) [50]
    • show the threading mode in use in the about dialog
    • show average frame rate and frame spacing in about dialog
    • add a property specifying how much physical RAM is detected (to see if people are running out of RAM) [51]
    • is there a portable ARB/WGL extension to determine the amount of dedicated VRAM available ?
    • try to detect Intel GPUs and Mesa drivers ? (some of the more common issues were related to Intel/Mesa)


  • Changelog / Release Announcement:
    •   Walking through the list of "lessons learned" as part of the "Upcoming release" announcement was useful [52]
    • IMPROVE RELEASE PLAN: Probably it would be even better to directly process all "lessons learned" items and improve the release plan after each release accordingly  
    • To get to the 3.0 goal sometime in the near future, it's probably a good idea to create a backlog of open items in the wiki and link the release plan document to that. As usual, we don't have to be perfect for a new major release number. But the new features being the reason for the new major number should work reasonably correct. [53] (also see Category:Developer Plans)
    •   Posting the link to the changelog for the upcoming release helped writing the changelog early, this should also be done for the Hardware Recommendations and Notebooks known to run FlightGear pages probably?
    •   The changelog can be easily written by using "git log", searching the issue tracker and by going through the last 6 newsletters published since the previous release. It might make sense to explicitly add a "ChangeLog" message to important commits, so that the Changelog can be compiled more easily ?
    • Alternatively, request developers to add major changes also to $FG_SRC/ChangeLog again (last updated in 2001)?
    • IMPROVE RELEASE PLAN: for the web-based release announcement, it would be helpful to have screen shots or even youtube videos to demonstrate new features - get the community involved EARLY  
    • IMPROVE RELEASE PLAN: it may make sense to also allow artwork contributors to contribute new splash screen images for use in the upcoming release. The screen shot contest should provide plenty of options   [54].
    • IMPROVE RELEASE PLAN: a screenshot/banner contest should be held early on, so that we can use the images for our promo work-NOT after the release   [55]
    • IMPROVE RELEASE PLAN: for the changelog we should early on invite volunteers to help translate it, useful for the release promotion  
    • IMPROVE RELEASE PLAN: having dedicated promo videos sounds like a good idea   , see [56] Howto:Creating FlightGear Promo Videos
    • The RC announcement should also contain links to 1) the issue tracker and 2) the RC subforum [57]
    • Using wiki tagging, we could ensure that we can also tag our wiki documentation after each release, so that we can provide older versions of our docs for old FG versions [58]
    • various files in $FG_ROOT haven't been updated in YEARS, either update them in the future, or just get rid of them: THANKS, NEWS, ChangeLog etc
  • Shaders:
    • the ATI viewport hack didn't seem enabled in the RCs, as reported by a number of users on the forum [59]
    • the ATI viewport hack should only be enabled by default if ATI/AMD hardware is detected [60] [61][62]
    • we should probably try to detect if software emulated OpenGL is in use (i.e. using Mesa) and show a corresponding warning [63]
    • texture compression should be disabled by default [64] [65] [66] [67] [68]
    •   lowering the default shader level to 1 improved compatibility for older/underpowered systems [69]
    • but there were still many users reporting issues like crashes/segfaults during startup, that seemed affected by changing graphics settings [70]
    • we should make sure that the default shader level (and related shaders!) works for all common setups, including ATI/AMD cards (Mac!) and Intel GPUs
    • IMPROVE RELEASE PLAN: GLSL shaders and effects should be treated like core code, and should be tested on different platforms before being enabled by default (i.e. signed-off by people using NVIDIA, ATI/AMD, Intel)   [71]
    • IMPROVE RELEASE PLAN: modified shaders should be tested with other shader-related features to prevent breakage   [72] (there might be a way to automate this a litle by catching GLSL compiler errors?)
    • to address all the intel GPU related issues, we may want to show an info dialog on computers where /sim/rendering/gl-vendor contains "intel" as a substring and provide an option to disable all shaders [73]
    • we probably need a separate article detailing GLSL coding requirements to ensure that portable constructs are used [74] so that problematic shaders are not just identified at the end of the release cycle
  • Installer:
    • The installer should be updated to show a warning regarding TerraSync update time [75]
    • When Flightgear releases a new version, can the staff create a way for the average computer users to install a new version without doing anything to the old version but still use the terrain files from the older version? [76]
    • I believe Fred intentionally chose to use the same registry key from one version to the next. Thus if you install a new version over the top of an existing version it will end up in the same path under C:\<PF> [77]


  • FGData related (Base Package):
    • accessibility of README files in $FG_ROOT/Docs should be improved for our Win/Mac users [78]   Fixed since 2.11+ (by Stuart)
    • aircraft included in the base package should not require DDS support [79]
    • a bunch of Intel GPU related issues were tracked down to be related to texture dimensions beyond 512x512 not being supported, suggested workarounds are mentioned at [80]
    • "Funny how the 172P doesn't have it (crash detection via limits.nas). It is something like a default aircraft for the sim, isn't it? Which aircraft are considered the most "finished"?" [81]
    • " I'm a bit confused by all the aircraft models in various stages of completion. Even the install package comes with some below-par and alpha stage models. Is there a compiled list of aircraft that are considered "well done"?" [82]
    • The default set of airplanes in FG should be the absolute best of the best, simply because that's what a new user is going to be exposed to for their first time. [83]
    • Language files should be synced between English and other languages, so translators can work on them before the release ;-)
    • the nasal_api_doc.py script in $FG_SRC/scripts/python should be run as part of the release process, to create an updated doc file for $FG_ROOT/Docs and ship it with each release [84]
    • IMPROVE RELEASE PLAN: New/updated Nasal scripts contributed to the base package should be checked to properly support important features like simulator reset, this also applies to Nasal scripts used by aircraft, Nasal scripts that fail these criteria, end up breaking existing features!   [85] (also see Release:Aircraft Selection Criteria)
    •   regarding aircraft included in the release: "I must stress usefulness of the Autostart feature, present in most aircraft not running at startup. It keeps frustration away from those who just want to enjoy the flight . (Please note that I actually agree with aircraft being shut down at startup, as long as autostart is present, or the starting procedure is trivially doable by just trying what you see in the cockpit.) " [86] (also see Release:Aircraft Selection Criteria)
    •   also, it would apparently make sense to provide tutorials for the default aircraft: "At first startup, I noticed the "Need help? use help->tutorials" message, and because I had no idea how to start up the plane (it would be just plain try and fail, than try something else), I did just that and started some basic tutorials. I wouldn't say going through the tutorials was frustrating, but they were quite boring and I was eager to get in the air as soon as possible." [87] (also see Release:Aircraft Selection Criteria)
    • "I discovered however, that there can be some problems on Linux about the planes (eg. some versions of the L39 Albatros undergoing several improvements lately). The problems can be caused by Linux being case sensitive about file paths (Windows is not), and I suspect, more models could suffer from some developers not knowing that. It's easy to fix if you know about the problem, but it would better be done on the developer side, as you never know if the smoke is just not implemented or missing due to this. Not to mention how lengthy it would be to go through more aircraft..." [88]
    • Docs: Relevant FlightGear paths should ideally not be "hard-coded" in the manual, but rather also configured via the build system, i.e. using cmake, so that the FG/SG cmake configuration can be shared, to automatically update the correct paths without requiring manual maintenance [89]
  • Usability:
    • the huge number of ads placed on the official website, and the non-intuitive layout of the website caused quite some irritation, not only among new users, but also among seasoned long-time contributors - flightgear.org has been repeatedly described as leaving the impression of even being a "scam" [90] [91]
    •   A little downside is how the FGcom is done as a standalone program just cooperating with FG itself. It took me some fiddling with the settings for about two hours to get it working, but again installation was simply done from repos (FGcom and than FGcomGui as well). [92] (this is planned [93])
    •   Most likely because of the Intel graphics, I suffered for a long time from a problem with aircraft models (and some ground textures too) being black or missing some parts (see my post in an older thread complaining about similar problem). I solved it by adding a command line option turning off texture compression. [94] (also see Release:Aircraft Selection Criteria)
    • We should probably add a new menu to the menubar for our online resources (wiki, forum, issue tracker, FAQ) so that people more easily find important resources just by selecting them from a menu.
  • Release Candidates:
    • a number of users reported crashes, for better debugging support, consider linking in Google BreakPad (cross platform stack traces) [95]
    • Release Candidates should probably have a higher default logging level while writing everything to a log file that can be easily shared via the issue tracker/forums, so that end users can provide better bug reports.
    • some users reported "OpenGL out of memory" and "out of space" errors when testing the RCs, we may want to link in a leak detector library or simply add BoehmGC - which is used by Mozilla to track leaking subsystems (a runtime log is created and dumped at process termination), that way non-developers could provide better leak reports. [96] [97] [98]
    • How about having a test run a week or two in advance, just to make sure we can indeed produce release installers for Win+Mac - and then release the first RC on December 17th/18th or 19th [99]
    • We've already got a fairly extensive lead-in time for the release. More testers on more platforms would seem to be the answer. Perhaps we should advertize for testers of those platforms that aren't adequately covered by developers running git? Making a complete package available, not just the binaries would help, as testers wouldn't need to be git-aware. [100]
    • IMPROVE RELEASE PLAN: The main area to improve is to distribute release candidates for all platforms earlier - preferably starting immediately after the freeze. That would already give us more time for testing - without extending the actual freeze period.   [101]
    • IMPROVE RELEASE PLAN: aircraft packages should be prepared prior to the official release date: "For the 2.8 release I didn't start making aircraft download packages (or uploading them to the ftp servers) until after the official release date which was a mistake"   [102]
    • IMPROVE RELEASE PLAN: RC's should probably be built with Built-in Profiler support enabled   [103].
    • IMPROVE RELEASE PLAN: When releasing RC's do not limit them to Win/Mac binaries, but also create source snapshots so that distros can already work on the next package versions.  
    • IMPROVE RELEASE PLAN: For RC's it might make sense to distribute binaries with debugging symbols included   and profiling support enabled, so that people can more easily provide useful bug reports, or even backtraces.
    • Also, many end users still prefer using the forum for making bug reports and don't use the issue tracker - it might help to add a link (button) to the issue tracker to the about dialog or maybe even directly to the help menu ("Report an issue") (same for wiki/troubleshooting/faq ?)
    • IMPROVE RELEASE PLAN: it might make sense to give wider exposure to our RCs, i.e. via the newsletter - possibly by adjusting the release schedule  
    • actually, it would even seem better to use our Release promotion checklist to send out an "Upcoming Release" announcement 4-6 weeks prior to the actual release, so that all the flightsim websites can notify their users to participate in RC beta testing.
    • a number of forum users reported that the RC/release mirrors were a real bottleneck, and that downloading the 800MB RC installer would often take 2-3 hours (using torrents instead was suggested)
    • it also seemed that a number of users had issues related to their browser corrupting the huge image download [104] (website should suggest to use a download manager instead!)
    • so reducing the size of the installer (i.e. base package) would seem like another good idea to give our RCs wider exposure, for example by focusing only on 2-3 aircraft
    • certain reported issues were really tricky to reproduce, we may want to provide an option to export crucial runtime settings to an XML file that can be easily shared with other testers/developers, or even extend the new flight recorder/replay tape system accordingly [105]
    • it might be good if the forum release-candidates announcement mentions that tests and bug-reports should be done with a clean install of the release-candidate, with no third-party data used in tests.
  • Build related:
  • A normal Linux user has practically no chance to get last stable on his box running if it isn't in his distro - a normal Windows user gets everything nice and streamlined. [106]
  • According to the issue tracker there were 3-5 different contributors who provided C++ patches that didn't end up reviewed/merged, which caused some irritation.

2.8

2.6

  •   feature freeze in general
    helped a lot during release management. Kept the commit traffic low and thus helped identifying those commits required to pick into the release.
  •   feature freeze for aircraft
    Technically, a feature freeze for aircraft is not necessary as long as this aircraft is not part of the base distribution and no common parts are affected. If it's guaranteed that the changes remain in FGDATA/Aircraft/MyAircraft and no other files are touched, these updates should be OK up to shortly before the release.
  •   switching to a new version of supporting libraries like OSG.
    The move to OSG 3.x introduced some major issues. If at all possible, switch to a new library early in the development cycle.
  •   manual creation of release candidates and the release binaries
    It's preferable to have equal numbers for release candidates for all O/S and probably a git-tag for each candidate.
  •   release date/time frame
    It took several days to release all the subparts. Might be better to upload all files and pages to hidden folders and publish them all at once (or at least within a couple of hours). That'll have several advantages:
    • no big difference between releases for the various OS.
    • the website will switch to the new release state quickly. With 2.6.0, the aircraft page was published before the setup. The release announcement was published even later.


  1. James Turner (Mon, 24 Jun 2013 14:15:00 -0700). Re: [Flightgear-devel] reminder: entering feature freeze now.
  2. James Turner (Mon, 24 Jun 2013 14:15:00 -0700). Re: [Flightgear-devel] reminder: entering feature freeze now.
  3. Stuart Buchanan (Tue, 25 Jun 2013 14:48:56 -0700). Re: [Flightgear-devel] reminder: entering feature freeze now.
  4. Stuart Buchanan (Tue, 25 Jun 2013 14:48:56 -0700). Re: [Flightgear-devel] reminder: entering feature freeze now.
  5. Curtis Olson (Tue, 25 Jun 2013 14:59:08 -0700). Re: [Flightgear-devel] reminder: entering feature freeze now.
  6. Stuart Buchanan (Mon, 08 Jul 2013 14:42:16 -0700). Re: [Flightgear-devel] reminder: entering feature freeze now.
  7. James Turner (Wed, 17 Jul 2013 12:39:56 -0700). [Flightgear-devel] 2.12 is branched.
  8. James Turner (Wed, 26 Jun 2013 02:49:00 -0700). Re: [Flightgear-devel] reminder: entering feature freeze now.
  9. James Turner (Wed, 26 Jun 2013 02:49:00 -0700). Re: [Flightgear-devel] reminder: entering feature freeze now.