User:Callahanp: Difference between revisions

From FlightGear wiki
Jump to navigation Jump to search
(26 intermediate revisions by the same user not shown)
Line 1: Line 1:
=== What I'm doing: ===
I am a flight simulation hobbyist currently working on building instruments, gauges, radios and controls for a C172.  
I am a flight simulation hobbyist currently working on building instruments, gauges, radios and controls for a C172.  


I'll be working on the interface between Flightgear and low level hardware in a panel or cockpit. It is my understanding that others, including core Flightgear developers are also working on this and my efforts will  follow, derive from, depend on and I hope contribute in some small way to their work.
== What I'm doing: ==
===[http://wiki.flightgear.org/User:Callahanp/FlightgearWorkingGroups Flightgear Working Groups]===


Recently I began the effort to fully understand the skills needed to contribute to the Flightgear project's codebase.  I know c++ from a course in the early 90's.  I'm looking at Kdevelop and QTquick as development tools.
==== [[https://github.com/c172p-team/c172p C172P Team on Github ]] ====


=== Flightgear Codebase ===
Proposed:


My area of interest is in Flightgear's code includes:
* Subsystem Management Group
* Property Tree Dwellers
* Vulcanologists
* Plib Janitors
* FDM Dev
* Flightgear Dev Onboarding
* Flightgear Dev Scenery
* Flightgear Dev Core
* Flightgear Dev Aircraft
* Flightgear Dev Airports
* Cockpit Builders


* telnet
===[http://wiki.flightgear.org/User:Callahanp/Flightgear_and_Simgear_Code Flightgear and Simgear Code]===
* phi
* reset & re-initialize
* any method to set or get a property
* the property tree itself
* configuration files
* command line parameters


I'm beginning to look through various parts of the Flightgear code-base to understand how the parts fit together and how supporting libraries are used in the project.  I'd like to learn how aircraft data and graphics are integrated into the working program, and how, why and where Nasal scripting is used.  To this end, I have
Several years ago I began the effort to fully understand the skills needed to contribute to the Flightgear project's codebase.  I started to look through various parts of the Flightgear code-base to understand how the parts fit together and how supporting libraries are used in the project.  
* Built a full debug version of the next branch
* Installed
** [https://gdbgui.com/ gdbgui]
** [https://atom.io/ atom] for basic code exploration.


Later I'll try QtCreator
This is an ongoing effort hampered by lack of time, my obsolete C++ training obtained in the early 1990's.


Here's my directory structure for building
==== Tools ====


*$HOME
[[User:Callahanp/Flightgear_and_Simgear_Code/Tools_for_a_Flightgear_Developer|Tools for a Flightgear Developer]] (see also [[Tools of the Trade]])
** A separate disk to make it easy to reinstall linux.  $HOME is the same as /home/$USER
*$HOME/fg
** Scripts I need to build and flightgear such as download_and_compile.sh, and /run/debug script
** This is actually a symlink to a folder on a separate disk from /home. 
** I do this so I can build the software I want without continually expanding my home disk's size.
** The fg directory contains a folder for each different build of Flightgear.
*** next for running next
*** nextrti for running next with OpenRTI
*** nextd for debugging next
*** stable
*** stabled
** Each of these directories contains clones for flightgear, simgear and other projects like OSG and OpenRTI as needed.


Rather than use excessive bandwidth, when I need a fresh copy, I just run download_and_compile.sh in a folder that already has a copy of the sources. Then I copy the folder over to the one I want to refresh and remove the build folder within the new one.  Then run the script again to produce the executable version I want. As currently structured, download_and_compile.sh requires a separate set of sources for each different version built.
==== From Command Line to Holding Short ====


Here's the atom/run/debug script I use for debugging
[[User:Callahanp/Flightgear_and_Simgear_Code/From_Command_Line_to_Holding_Short|From Command Line to Holding Short]]. A look at what gets called when you start Flightgear from the command line until you are on the runway.  This is a work in progress, somewhat stalled after Eduard Auvergne's initial work on subsystems.  It needs a re-vamp to make it current and publishable.
cd $HOME/fg/


#!/bin/bash
==== Flightgear Application Outline ====
# ~/fg/debug


$cmd = "$HOME/fg/nextd/install/flightgear/bin/fgfs \
I'm trying to come up with an outline of Flightgear's structure as an application.  
  --fg-root=$HOME/fg/nextd/install/flightgear/bin/../fgdata/ \
  --log-level=2 \
  --fg-scenery=$HOME/fg/nextd/install/flightgear/bin/../fgdata/Scenery \
  --fg-aircraft=$HOME/fg/nextd/install/flightgear/bin/../fgdata/Aircraft \
  --fg-aircraft=$HOME/.fgfs/Aircraft/org.flightgear.fgaddon/Aircraft \
  --httpd=5401 --telnet=5400 --airport=KSFO"


  $gdbgui "$cmd"
[http://wiki.flightgear.org/User:Callahanp/Flightgear_Technical_Manual| Flightgear Technical Manual]


When the source window appears, press the "r" key to start debugging.
First Steps:  


I start by stepping through bootstrap and other modules until flightgear is up and running.
===== RTFM =====
I'm making some notesThere are three sections:
* http://wiki.flightgear.org/FlightGear_Manual
* fgdata/doc/img Look at each image in, noting the name of the image and what the image is trying to say
* fgdata/doc/keyboard/map.pdf  Note that key bindings can be specific to an aircraft. Note that the pdf was produced from a .tex file.
* fgdata/Docs/model-combined.eff/README.model-combined.eff  Read and not What's "rembrandt" - Key terms can be pulled from this document
* fgdata/Serial/nmeafaq.txt  Garmin -    Key terms can be pulled from this document. This document describes a data protocol
* AI_doc.html  
* FGShortRef.html
* http://flightgear.org/Docs/FlightGear-FAQ.html
* fgdata/Docs/fschool_0.0.3.pdf
* fgdata/Docs/index.html
* fgdata/Docs/model-howto.html
* and lots of others  - point is you have to read them all


* '''Path''' will trace the path through modules that provide significant functionality to the Simulator until the aircraft is shown holding short or parked somewhere. only the module's source path and a brief explanation or list of why it's on the "path".
Once they're read, is there a way to organize them so the result is an overview?
* '''Modules''' lists all the classes and methods or functions executed on the "path" as well as those that are not executed in the path.
* '''Utility Calls''' will contain notes on various library calls, noting what the call looks like, where the library comes from, what the call does and where else it might be used. These will be functions with a purpose that is not limited to flight simulation.


====The Path to "Holding Short"====
Sure there is. Just write a book: working title: [Flightgear_Technical_Manual|Flightgear Technical Manual]


{| class="wikitable"
=====It's Data Driven - So Where's the data? =====
|-
! Module !! Description !! Steps
|-
| src/Main/bootstrap || Bootstrap provides the top level of the stack for executing either fgviewerMain or fgMainInit.
|
* Enable Floating Point features with InitFPE
* Set locale settings specific to using C or C++
* Uninstall if requested
* Initialize logging
* Initialize some static objects in OSG to prevent crashes on exit
* set the std:: terminate function
* set the atexit function
* pass control to the viewer with fgViewerMain or initialize using '''fgMainInit'''
* catch throwables and other fatal error conditions, providing appropriate error messages
|-
| src/Main/Main || fgMainInit
|
* set logging level and enable logging
* setup globals as an instance of FGGlobals. 
|-
| Example || Example || Example
|}


====Modules on the Path to Holding Short====
I've realized that much of the application is data driven, and that data is found in various places. These include files in one or another imaging format .ac files and configuration files of various types including xml files.  Each of these references will involve a path of some kind creating a relationship between material in one file with material in another.  There are path like structures to be found in data structures constructed within the application itself. This happens most notably in the property tree, but also in other independent data structures such as the  structure controlling subsystem initialization, ongoing processing, removal and re-initiialzation. 
To uncover some of these relationships and to locate and characterize the various processes involved, a close look at similar code fragments in a large number of files will enable you to uncover patterns that might otherwise elude you.
The basic technique will be o use an editor such as Atom, capable of doing a recursive global search through a set of files using a series of regular expressions.  Using regular expressions allows us to go from a more general search to one that is more specific.  All the following examples use atom's find in project - regex - case insensitive search.


the gdb run command gets things going in gdbgui. Just type "r"


I'm going to record a list of functions called, in the order they are called in with descriptions where appropriate.
to get information about where these functions are located, I'll use the atom's project search or the step into feature of gdbgui.
If the call is along the main line of execution, it will be in Bold Face.  Paths start with directories under flightgear/src, except for /simgear which is under /simgear.  Yes there is a simgear/simgear in the path.  There's proably a reason why its not simgear/src


=====bootstrap.cxx=====
The code fragments to search for To get a list of 
{| class="wikitable"
the include= vs <path> dichotomy is a distinction I'd like to investigate and describe further and the handlers for each of these "types" 
|-
I thought it might be worth going down the rabbit hole to explore a bit. 
! Full Text of Call !! Called Function Location or Include File !! Notes
|-
| '''command line''' || in bootstrap.cxx <br>'''main(argc, argv)''' || bootstrap.cxx contains the main function.  main.cxx does not.
|-
| detectSIMD() || bootstrap.cxx || returns true if the cpu supports sse2.
|-
| gethostname(_hostname, 256) || unistd.h glibc || returns the hostname of your computer
|-
| signal(SIGPIPE, SIG_IGN) || signal.h || directs SIGPIPE to the SIG_IGN signal handler - Portability: use sigaction() instead
|-
|  signal(SIGSEGV, segfault_handler) || signal.h  || Flightgear formats the message with a backtrace and exits with std:abort()
|-
|  segfault_handler (int signo) || bootstrap.cxx  ||
|-
|  '''initFPE'''(flightgear::Options::checkForArg(argc, argv, "enable-fpe")) || main/options.cxx<br>  bootstrap.cxx || checks the command line arguments for the enable-fpe option. Calls InitFPE with the result. <br> see bootstrap.cxx for more details
|-
|  signal(SIGFPE, handleFPE) || signal.h<br/> bootstrap.cxx || We handle Floating Point Exceptions
|-
| setlocale(LC_ALL, "") <br/> setlocale(LC_NUMERIC, "C") <br/> setlocale(LC_COLLATE, "C") ||  ||
|-
| return fgUninstall() || fg_init.cxx || Command line options are checked to determine if uninstall should be called.
|-
| sglog() || /simgear/debug/logstream.cxx || This initializes the log. see logstream.cxx for details
|-
| std::set_terminate(fg_terminate); || <exception> <br> bootstrap.cxx || sets the standard template library terminate routine<br>
|-
| atexit(fgExitCleanup) || stdlib.h<br> bootstrap.cxx || registers the given function to be called at normal process termination, either via exit(3) or via return from the program's main().  Functions so registered are called in the reverse order of their registration; no arguments are passed
|-
|  fgviewerMain(argc, argv) || flightgear/Viewer/fgviewer.cxx  || see viewer topics for details.  This is called in bootstrap.cxx if the command line arguments include --viewer
|-
| '''fgMainInit(argc, argv)''' || '''Main/main.cxx''' || Starts to initialize flightgear.  This is called in bootstrap.cxx if command line arguments do ''not'' contain --viewer
|-
| catch block || various || termination for most or all errors. Read the end of bootstrap.cxx for more information
|-
|  flightgear::shutdownQtApp() || bootstrap<br/> Qt ||  Done separately from atexit. see bootstrap.cxx for more information
|-
| crInstall(&info)<br>crUninstall() || [http://crashrpt.sourceforge.net CrashRpt.h] || #if defined(HAVE_CRASHRPT). This only happens on windows.
|}


=====Main/main.cxx=====
Keep in mind I'm looking for important concepts that I don't yet have in my outline.  The key to finding them is recognizing the variety of tags found in xml files.  For the moment, I'm looking for tags and other structural identifiers that refer to materials in other files.  
{| class="wikitable"
|-
! Full Text of Call !! Called Function Location or Include File !! Notes
|-
| from bootstrap.cxx <br/> '''fgMainInit'''( int argc, char **argv ) || '''Main/main.cxx''' || all the arguments from the command line are still there
|-
| sglog().setLogLevels( SG_ALL, SG_INFO )<br>sglog().setStartupLoggingEnabled(true); || /simgear/debug/logstream.cxx || Pretty obvious what this does. || '''What does sglog() actually return?'''
|-
| new '''FGGlobals'''; || Main/FGGlobals.cxx || FGGlobals is a bucket for subsystem pointers and properties representing the sim's state. It's constructor populates the values, including  the locale, the root node of the property tree, the subsystem, event, command and resource managers. It also adds resource providers for Aircraft, he Aircraft Directory and Add-ons. || Question: What is it that makes globals = new FGGlobals a global object. Here it's a local variable isn't it? Wouldn't it go out of scope in things fgMainInit calls?
{{WIP}}
|}


=====Main/FGGlobals.cxx=====
I'm also adding other concepts driven by data from xml files such as  animation, interpolation and the various types of tags with xml files found in the files for the C172p such as checklists, tutorials, instrument and signals.  examples of these are easy to find in an editor capable of text searching an entire project:


{| class="wikitable"
Try the following in atom and you'll see what I mean 
|-
! Full Text of Call !! Called Function Location or Include File !! Notes
|-
| new '''FGRenderer''' || Main/globals.cxx<br/>Viewer/renderer.cxx || || Why is the definition in globals.cxx and in renderer.cxx
|-
| new '''SGSubsystemMgr''' || Main/globals.cxx<br/>Main/subsystemFactory.cxx<br/>simgear/structure/subsystem_Mgr.cxx || What makes a component a candidate for inclusion under the subsystem manager?
|-
| new '''SGEventMgr''' || Main/globals.cxx<br/>simgear/structure/event_mgr.cxx ||
|-
| '''SGCommandMgr'''::instance() || Main/fg_commands.cxx<br/>imgear/structure/commands.cxx <br><br>see also:<br>Main/subsystemFactory.cxx<br>Scripting/NasalSys.cxx for NasalCommand ||
|-
| SGPropertyNode* root = new '''SGPropertyNode'''<br/>  props = SGPropertyNode_ptr(root);|| all of simgear/props || Widely Used || How much of the property Node system does one need to understand?
|-
| locale = new FGLocale(props); || ||
|-
| auto resMgr = simgear::'''ResourceManager'''::instance()|| simgear/misc/ResourceManager.cxx || ||Review: auto and what does the resource manager do?
|-
| new '''AircraftResourceProvider'''() || Local Function ||
|-
| new '''CurrentAircraftDirProvider'''()|| Local Function ||
|-
| new flightgear::addons::'''ResourceProvider'''() || ||
|-
| init_properties()||local function || adds property tree nodes for position/, current-view/ and orientation/
|-
|
sim_time_sec( 0.0 )<br/>
fg_root( "" )<br/>
fg_home( "" )<br/>
time_params( NULL )<br/>
channel_options_list( NULL )<br/>
initial_waypoints( NULL )<br/>
channellist( NULL )<br/>
haveUserSettings(false)
| FGGlobals class initializations || things to be set later


cd next/install 
atom . 


|}
Use the atom FindInProject->Find All with any of the following.  Be sure to click on the regex button for the search


=====Main/fg_init.cxx=====
* include=
{{WIP}}
* <path>
{| class="wikitable"
* <path>.*\.xml
|-
* <path>.*\.png
! Full Text of Call !! Called Function Location or Include File !! Notes
* <path>.*\.ac
|-
| '''fgInitConfig''' || locally defined ||
* sets up FG_HOME in the property tree, making sure it exists
* sets developer-mode when appropriate
* Read global defaults into globals->get_props() from $FG_ROOT/defaults
|-
| || ||
|-
| || ||
|-
| || ||
|-
| || ||
|}


==== Progress on Cockpit Building ====
etc.
Scanning the results of the search for include= reveals that they're all found in fgdata. 
 
* All include references to .xml files and the references themselves are found in xml files.
* There are 2117 of them in 1274 files.
* AI/Aircraft alone contains about 75% of the includes.  These are for individual liveries.
* Aircraft/c172p gives you a preview of the kind of xml strucures you'll find in any aircraft.  
* Aircraft/Generic contains about 5% of the includes. They include items for specific instruments, the walker, a logo,  
* ATC  contains a few files with xml includes related to ATIS.Compositor contains several xml includes. This one is likely to be important. 
* defaults.xml is likely to be a high level module and therefore important 
* Docs contains a number of README.xxxxx files, likely to be informative. Some have xml includes referenced in them. As I've mentioned, you should read every single one.
* Instruments contains about 5% of the includes. They include items for specific instruments, the walker, a logo,  
* Environment has two files one with filter tags related to xml files describing clouds and the other with tags for cloudLayers and volcanos. 
* Input has xml related to joysticks.  there's also a top level file  fgdata/joystics.xml 
* Materials makes up the remaining 15% of xml. it includes xml data related to runway textures and effects, buildings, geographic region textures and groups of objects.  
 
Scanning for <path> reveals a similar pattern, but <path> is used for more than just .xml files.
 
The total of 5067 <path> instances in 1745 files breaks down this way:
* .ac files with 1868 instances of <path> in  1509 files
* .rgb files with 798 in 108 files.
* .png files with 55 in 14 files
* .jpg 19 in 6 files
* .wav 113 in 9 files 
* .xsl 2 in 1 file 
* .http or .html 3 in 3 files
* .xml  with 2138 in 279 files 
 
The xml paths have a similar distribution pattern to the include= xml references, but further investigation is needed to discern how they are different.
 
Finally, <path> appears in Comments in 6 files, and is mentioned in 6 readme files.
 
<path> appears in one file 43 times with an <fgproperties> tag
 
==== Flightgear and Simgear Directory Descriptions and File Counts ====
 
[[User:Callahanp/Flightgear_and_Simgear_Files |Descriptions and file counts of flightgear/src and simgear/simgear subdirectories]]  What's where, What the heck is it anyway?
 
==== Flightgear/Simgear Code Exploration Project ====
 
see [http://wiki.flightgear.org/User:Callahanp/Flightgear_and_Simgear_Code Flightgear and Simgear Code]
 
==== Why I'm reading code ====
 
I'll be working on the interface between Flightgear and low level hardware in a panel or cockpit.  It is my understanding that others, including core Flightgear developers are also working on this and my efforts will  follow, derive from, depend on and I hope contribute in some small way to their work.  While I could just focus on the property tree and network interfaces, I still want a basic understanding of all areas of flightgear.
 
=== IDEs ===
 
Working on Configurations for Eclipse and QTCreator IDEs
 
 
=== Figuring out how to contribute to FlightGear ===
[http://wiki.flightgear.org/User:Callahanp/Flightgear_and_Simgear_Code/Onboarding Onboarding: Getting up to speed]
 
[[Getting things done in Flightgear]]
 
=== Progress on Cockpit Building ===


As of Feb 1, 2018:
As of Feb 1, 2018:
Line 237: Line 163:
* [[User:Callahanp/Snippets |Snippets]] of text that may or may not be used somewhere
* [[User:Callahanp/Snippets |Snippets]] of text that may or may not be used somewhere


===== Contact =====
=== Contact ===


Maybe our projects overlap and maybe I can be of help you in some small way. I love bouncing ideas back and forth in personal or public e-mails.  Feel free to contact me about your non-commercial simulation projects. <br> '''[[Special:EmailUser/Callahanp | Email Callahanp through the wiki]]'''
  '''[[Special:EmailUser/Callahanp | Email Callahanp through the wiki]]'''


I show up occasionally on #flightgear on irc.flightgear.org and am a member of several public forums related to cockpit building.
I show up occasionally on #flightgear on irc.flightgear.org and am a member of several public forums related to cockpit building.
Line 245: Line 171:
[[User:Callahanp|Callahanp]] ([[User talk:Callahanp|talk]]) 09:45, 11 November 2017 (EST)
[[User:Callahanp|Callahanp]] ([[User talk:Callahanp|talk]]) 09:45, 11 November 2017 (EST)


===== My Skills =====
=== My Skills ===
* Programming in whatever language is available
* Programming in whatever language is available
* Databases
* Databases
Line 264: Line 190:


* Avoiding Writing Howtos
* Avoiding Writing Howtos


===== My Developing Skills -- Making Good Progress =====
===== My Developing Skills -- Making Good Progress =====
Line 269: Line 196:
* Fusion 360 3dCad  
* Fusion 360 3dCad  
* 3d Router
* 3d Router
* Tormach 1100 CNC Mill
=== My Projects ===
==== [[ C172P Cockpit ]] ====
==== [[ Cockpit Inteface for Flightgear ]] ====
==== [[ Flightgear Editable Orthographic Views ]] ====
==== [[ Up to speed coding C++ for Flightgear ]] ====
===UFO? You decide...  ===
Flightgear of the Future.
There's been recent discussion of what it would take to write Flightgear from scratch today.
I think a better question is how to go about undertaking any major restructuring of Flightgear's codebase to take advantage of modern tools and techniques.  And I think we already have an answer to that.
In fact, there's an excellent example happening right now in the Spring of 2018. It's Edward's work on unit testing and the restructuring of the subsystem manager.  If you're interested in how big changes come about I'd suggest reading everything related to this effort rather closely and following the ongoing discussion over the need to refactor the way flightgear subsystem dependencies are handled.  Look not just for the technical details, but for the way Edward limited the scope of his current activity and for the quality of the interactions between the interested parties.  I think its a model for anything major anyone wants to undertake in Flightgear.  In fact this kind of interaction is nothing new in the flightgear project.  Other examples abound. Everything from the adoption of OSG to QT has gone through a similar process.
Those of us who want to be involved in ''big changes'' need to know this process well.  So read the mailing list entries in detail and notice the choices people are making and the reasons why.  The last thing anyone wants is divisive discussion over direction or choices already made. Especially where the root of the discussion is a misunderstanding or refusal to recognize how the project actually works over a period of time.
So now here's my take on what would be a big Flightgear code change - [[Multicore Processing and Clusters]].  The changes in play today lay the groundwork for this.
References:
* [https://sourceforge.net/p/flightgear/mailman/search/?q=If+you+were+to+write+FlightGear+today... If you were to write FlightGear today... ]
* [https://sourceforge.net/p/flightgear/mailman/search/?q=Designs+for+the+subsystem+manager%2Ffactory. Designs for the subsystem manager factory ]
* [https://sourceforge.net/p/flightgear/mailman/search/?q=Code+formatting+for+the+whole+FlightGear+codebase Code formatting for the whole FlighGear codebase ]
* [https://sourceforge.net/p/flightgear/mailman/search/?q=Questions+about+TestSuite Questions about the TestSuite ]
* [https://sourceforge.net/p/flightgear/mailman/search/?q=CppUnit+branches+for+merging%2C+and+an+event+manager+timer+queue+rewri CppUnit branches for merging ]
=== The Howtos ===
'''-- Oh yeah... those...'''


==== The Howtos -- Oh yeah... those...====
I'm working on these along side building my cockpit.  Some of the early attempts were not that useful.  My current approach is to build and document actual hardware.  I hope this will be more helpful.
I'm working on these along side building my cockpit.  Some of the early attempts were not that useful.  My current approach is to build and document actual hardware.  I hope this will be more helpful.


Line 285: Line 246:
Rule 1. Brevity.
Rule 1. Brevity.


Rule 2. Real Hardware.  If I haven't done it yet I'll talk about it on my personal wiki page.  That's where stuff like that belongs.   
Rule 2. Real Hardware & Software.  If I haven't done it yet I'll talk about it on my personal wiki page.  That's where stuff like that belongs.   


Rule 3. Project Planning, Building Teams, and anything else about developing a hobby project belong elsewhere.  If you want to write about these things, go ahead, but don't do it in a Howto on building something specific like a cockpit.  If you haven't done the project yet you'll get it wrong. Plus, you'll sound like a...
Rule 3. Project Planning, Building Teams, and anything else about developing a hobby project belong elsewhere.  If you want to write about these things, go ahead, but don't do it in a Howto on building something specific like a cockpit.  If you haven't done the project yet you'll get it wrong. Plus, you'll sound like a...

Revision as of 18:40, 8 November 2019

I am a flight simulation hobbyist currently working on building instruments, gauges, radios and controls for a C172.

What I'm doing:

Flightgear Working Groups

[C172P Team on Github ]

Proposed:

  • Subsystem Management Group
  • Property Tree Dwellers
  • Vulcanologists
  • Plib Janitors
  • FDM Dev
  • Flightgear Dev Onboarding
  • Flightgear Dev Scenery
  • Flightgear Dev Core
  • Flightgear Dev Aircraft
  • Flightgear Dev Airports
  • Cockpit Builders

Flightgear and Simgear Code

Several years ago I began the effort to fully understand the skills needed to contribute to the Flightgear project's codebase. I started to look through various parts of the Flightgear code-base to understand how the parts fit together and how supporting libraries are used in the project.

This is an ongoing effort hampered by lack of time, my obsolete C++ training obtained in the early 1990's.

Tools

Tools for a Flightgear Developer (see also Tools of the Trade)

From Command Line to Holding Short

From Command Line to Holding Short. A look at what gets called when you start Flightgear from the command line until you are on the runway. This is a work in progress, somewhat stalled after Eduard Auvergne's initial work on subsystems. It needs a re-vamp to make it current and publishable.

Flightgear Application Outline

I'm trying to come up with an outline of Flightgear's structure as an application.  

Flightgear Technical Manual

First Steps:  

RTFM
  • http://wiki.flightgear.org/FlightGear_Manual
  • fgdata/doc/img Look at each image in, noting the name of the image and what the image is trying to say
  • fgdata/doc/keyboard/map.pdf Note that key bindings can be specific to an aircraft. Note that the pdf was produced from a .tex file.
  • fgdata/Docs/model-combined.eff/README.model-combined.eff Read and not What's "rembrandt" - Key terms can be pulled from this document
  • fgdata/Serial/nmeafaq.txt Garmin - Key terms can be pulled from this document. This document describes a data protocol
  • AI_doc.html
  • FGShortRef.html
  • http://flightgear.org/Docs/FlightGear-FAQ.html
  • fgdata/Docs/fschool_0.0.3.pdf
  • fgdata/Docs/index.html
  • fgdata/Docs/model-howto.html
  • and lots of others - point is you have to read them all

Once they're read, is there a way to organize them so the result is an overview?

Sure there is. Just write a book: working title: [Flightgear_Technical_Manual|Flightgear Technical Manual]

It's Data Driven - So Where's the data?

I've realized that much of the application is data driven, and that data is found in various places. These include files in one or another imaging format .ac files and configuration files of various types including xml files.  Each of these references will involve a path of some kind creating a relationship between material in one file with material in another.  There are path like structures to be found in data structures constructed within the application itself. This happens most notably in the property tree, but also in other independent data structures such as the  structure controlling subsystem initialization, ongoing processing, removal and re-initiialzation.  To uncover some of these relationships and to locate and characterize the various processes involved, a close look at similar code fragments in a large number of files will enable you to uncover patterns that might otherwise elude you. The basic technique will be o use an editor such as Atom, capable of doing a recursive global search through a set of files using a series of regular expressions.  Using regular expressions allows us to go from a more general search to one that is more specific.  All the following examples use atom's find in project - regex - case insensitive search.


The code fragments to search for To get a list of  the include= vs <path> dichotomy is a distinction I'd like to investigate and describe further and the handlers for each of these "types"  I thought it might be worth going down the rabbit hole to explore a bit. 

Keep in mind I'm looking for important concepts that I don't yet have in my outline.  The key to finding them is recognizing the variety of tags found in xml files.  For the moment, I'm looking for tags and other structural identifiers that refer to materials in other files.  

I'm also adding other concepts driven by data from xml files such as  animation, interpolation and the various types of tags with xml files found in the files for the C172p such as checklists, tutorials, instrument and signals.  examples of these are easy to find in an editor capable of text searching an entire project:

Try the following in atom and you'll see what I mean 

cd next/install 

atom . 

Use the atom FindInProject->Find All with any of the following. Be sure to click on the regex button for the search

  • include=
  • <path>
  • <path>.*\.xml
  • <path>.*\.png
  • <path>.*\.ac

etc.

Scanning the results of the search for include= reveals that they're all found in fgdata. 

  • All include references to .xml files and the references themselves are found in xml files.
  • There are 2117 of them in 1274 files.
  • AI/Aircraft alone contains about 75% of the includes.  These are for individual liveries.
  • Aircraft/c172p gives you a preview of the kind of xml strucures you'll find in any aircraft.  
  • Aircraft/Generic contains about 5% of the includes. They include items for specific instruments, the walker, a logo,  
  • ATC  contains a few files with xml includes related to ATIS.Compositor contains several xml includes. This one is likely to be important. 
  • defaults.xml is likely to be a high level module and therefore important 
  • Docs contains a number of README.xxxxx files, likely to be informative. Some have xml includes referenced in them. As I've mentioned, you should read every single one.
  • Instruments contains about 5% of the includes. They include items for specific instruments, the walker, a logo,  
  • Environment has two files one with filter tags related to xml files describing clouds and the other with tags for cloudLayers and volcanos. 
  • Input has xml related to joysticks.  there's also a top level file  fgdata/joystics.xml 
  • Materials makes up the remaining 15% of xml. it includes xml data related to runway textures and effects, buildings, geographic region textures and groups of objects.  

Scanning for <path> reveals a similar pattern, but <path> is used for more than just .xml files.

The total of 5067 <path> instances in 1745 files breaks down this way:

  • .ac files with 1868 instances of <path> in  1509 files
  • .rgb files with 798 in 108 files.
  • .png files with 55 in 14 files
  • .jpg 19 in 6 files
  • .wav 113 in 9 files 
  • .xsl 2 in 1 file 
  • .http or .html 3 in 3 files
  • .xml  with 2138 in 279 files 
The xml paths have a similar distribution pattern to the include= xml references, but further investigation is needed to discern how they are different.

Finally, <path> appears in Comments in 6 files, and is mentioned in 6 readme files.

<path> appears in one file 43 times with an <fgproperties> tag

Flightgear and Simgear Directory Descriptions and File Counts

Descriptions and file counts of flightgear/src and simgear/simgear subdirectories What's where, What the heck is it anyway?

Flightgear/Simgear Code Exploration Project

see Flightgear and Simgear Code

Why I'm reading code

I'll be working on the interface between Flightgear and low level hardware in a panel or cockpit. It is my understanding that others, including core Flightgear developers are also working on this and my efforts will follow, derive from, depend on and I hope contribute in some small way to their work. While I could just focus on the property tree and network interfaces, I still want a basic understanding of all areas of flightgear.

IDEs

Working on Configurations for Eclipse and QTCreator IDEs


Figuring out how to contribute to FlightGear

Onboarding: Getting up to speed

Getting things done in Flightgear

Progress on Cockpit Building

As of Feb 1, 2018:

  • I've done only a few prototype circuits
  • have been working to develop skills I'll need to produce a realistic cockpit.
  • Developing skills in Fusion 360 to support 3d Printing and 3d machine tools.
  • Working on tests for a cluster based on Raspberry Pi Zeros
  • Beginning to use a 3d Router
  • Milling into thin prisms and hand polishing disks of plexiglass for illuminating dials in Sim Instruments

As part of my Cockpit Building efforts, I'm also working on

Contact

 Email Callahanp through the wiki

I show up occasionally on #flightgear on irc.flightgear.org and am a member of several public forums related to cockpit building.

Callahanp (talk) 09:45, 11 November 2017 (EST)

My Skills

  • Programming in whatever language is available
  • Databases
  • Making the following list of chips do what they do:
  • MCP23XXX Multiplexer
  • MAX7219 Serially Interfaced, 8-Digit LED Display Driver
  • Designing a few types of circuits that work on a breadboard (see electronics below)
My Developing Skills -- Beginner
  • Grokking Flightgear's code base.
  • Very basic machining on a lathe or mill - no significant experience
  • Electronics - Basics - DC, High & Low speed digital circuits, motor control, emi suppression and mitigation
  • Soldering - Learn to deal with small components
  • Designing circuits that make it from breadboard to cockpit.
  • Getting a cokpit project off the ground
  • C++ - Updating coding skills from an early version of C++
  • Avoiding Writing Howtos


My Developing Skills -- Making Good Progress
  • Fusion 360 3dCad
  • 3d Router
  • Tormach 1100 CNC Mill


My Projects

C172P Cockpit

Cockpit Inteface for Flightgear

Flightgear Editable Orthographic Views

Up to speed coding C++ for Flightgear

UFO? You decide...

Flightgear of the Future.

There's been recent discussion of what it would take to write Flightgear from scratch today.

I think a better question is how to go about undertaking any major restructuring of Flightgear's codebase to take advantage of modern tools and techniques. And I think we already have an answer to that.

In fact, there's an excellent example happening right now in the Spring of 2018. It's Edward's work on unit testing and the restructuring of the subsystem manager. If you're interested in how big changes come about I'd suggest reading everything related to this effort rather closely and following the ongoing discussion over the need to refactor the way flightgear subsystem dependencies are handled. Look not just for the technical details, but for the way Edward limited the scope of his current activity and for the quality of the interactions between the interested parties. I think its a model for anything major anyone wants to undertake in Flightgear. In fact this kind of interaction is nothing new in the flightgear project. Other examples abound. Everything from the adoption of OSG to QT has gone through a similar process.

Those of us who want to be involved in big changes need to know this process well. So read the mailing list entries in detail and notice the choices people are making and the reasons why. The last thing anyone wants is divisive discussion over direction or choices already made. Especially where the root of the discussion is a misunderstanding or refusal to recognize how the project actually works over a period of time.

So now here's my take on what would be a big Flightgear code change - Multicore Processing and Clusters. The changes in play today lay the groundwork for this.

References:

* If you were to write FlightGear today... 
* Designs for the subsystem manager factory 
* Code formatting for the whole FlighGear codebase 
* Questions about the TestSuite 
* CppUnit branches for merging 

The Howtos

-- Oh yeah... those...

I'm working on these along side building my cockpit. Some of the early attempts were not that useful. My current approach is to build and document actual hardware. I hope this will be more helpful.

Current Projects:

See below for the my personal rules about these howtos going forward. I had to write these because it was becoming a morass and time waster.

The following is yet another work in progress

Writing Advice to Callahanp from Callahanp  or How to write a Howto.

Rule 1. Brevity.

Rule 2. Real Hardware & Software. If I haven't done it yet I'll talk about it on my personal wiki page. That's where stuff like that belongs.

Rule 3. Project Planning, Building Teams, and anything else about developing a hobby project belong elsewhere. If you want to write about these things, go ahead, but don't do it in a Howto on building something specific like a cockpit. If you haven't done the project yet you'll get it wrong. Plus, you'll sound like a...

Rule 4. Grand visions, Vaporware, Abstract thinking, Advice and other nonsense don't belong anywhere.

Rule 5. Get rid of your darlings. Those witty turns of phrase, that elegant prose, the puns, jokes and asides. Fun to write maybe but not so fun to read. They're distractions. These are things a skillful writer can weave into an uninterrupted smooth train of thought but you're not that good a writer. Don't even try,

'nuff said.