Github Connector

To install this addon, you need to install some python dependencies

sudo pip install PyGitHub
sudo apt install cloc
sudo pip install pathspec
sudo pip install GitPython

Analysis source code is generated by

Once installed, you have to:

• Open your odoo.conf file and add extra settings to mention Github credentials, and the local path where the source code will be downloaded:
• source_code_local_path = /workspace/source_code/

Note: you can define the route as environment variable using the key SOURCE_CODE_LOCAL_PATH

Note: make sure that Odoo process has read / write access on that folder

> - github_token = your_github_access_token

Note: The login/password auth has been deprecated by GitHub.

• Go to 'Settings' / 'Technical' / 'Parameters' / 'System Parameters' and define the following values:
• github.max_try: number of call to the API before an error is raised. The more unstable/slow your connection, the higher should be this value
• git.partial_commit_during_analysis: Set to True if you want to commit the result of the analysis in the database after each repository analysis. We recommend to set to True when you perform the initial download (potentially with a lot of repositories) in order to reduce the size of the transaction
• Go to your(s) user(s) form to add them in the new 'Connector Github Manager' groups. The members of this group will have the possibility to run Github synchronization.

Technical Information

This module provides 4 crons that you can enable:

• Synchronize All Organizations and Teams (cron_update_organization)
• Synchronize Branches List for All repositories (cron_update_branch_list)
• Download Source Code for All Github Branches (cron_download_code)
• Analyze Source Code for All Github Branches (cron_analyze_code)

Initial upload from Github

To fetch information from Github, you have to:

• go to 'Github' / 'Settings' / 'Sync Object'
• Select the object type you want to synchronize and its Gthub name
• Once done for your organization(s), go to 'Github' / 'Github Commnunity' / 'Organizations'
• Optionally, once organization is created, you can create series for your projects. Go to 'Github' / 'Organizations' / click on your organization / 'Organization Series' Tabs

Select branches to download

This setting will prevent to download undesired branches, downloading only main branches (releases):

• In the 'Settings' tab, set repositories you don't want to download (or repositories you want to download). If 'Specific repositories' is set, 'Ignored Repositories' value is ignored.
• In the 'Settings' tab, set the URL of the 'External Services' you use for Continuous Integration and Coverage.
• Once done, click on buttons 'Syncs', to synchronize repositories, teams and members. (This process can take a while depending of your size)

Team / members synchronization

You can synchronize members teams:

• Go to 'Teams' / tree view / 'Actions' / 'Update from Github'.
• In each team, you can see the members list and the role of the members
• In each team, you can see the repositories list but not the permissions of the team. (See 'Known Issues' Section)

Repositories synchronization

You can synchronize the branches of your repositories:

• Go to 'Repositories' / tree view / 'Actions' / 'Update from Github'
• In each repository, you can see the main branches list and the size of code source.

Fetching the source code

Finally, you can download locally the source code of all your branches:

• Go to 'Repository Branches' / tree view / 'Actions' / 'Download and Analyse Source Code'.
• In the tree view you can update manually source code or refresh analysis.

Analysis source code

It's possible to create custom analysis rules that relate to a GitHub organization, GitHub repository and/or GitHub repository branch to analyze code.

• Go to 'Settings' / 'Analysis rule groups' and create records that allow to organize the rules
• Go to 'Settings' / 'Analysis rules' and create rules, for example:

> 1. Name: All code, Group: General, Paths: * > 2. Name: Python code, Group: General, Paths: *.py > 3. Name: Xml code, Group: General, Paths: *.xml > 4. Name: Repository 1, Group: Custom, Paths: /path/

Note: Paths field in 'Analysis rule' allow to put multiple paths for line, path format is according to

• Go to GitHub \> GitHub Community \> Organizations and define Analysis rules (optional)
• Go to GitHub \> GitHub Repository \> Repositories and define Analysis rules (optional)
• Go to GitHub \> GitHub Repository \> Repository Branches and define Analysis rules (optional)

Analysis source code is executed when 'Update Source Code Analysis' button in some 'Repository Branch', get all the Analysis rules (Repository + Organization) and analyze code and generate info about it Other option to Analysis source code is in cron called 'Analyze Source Code for All Github Branches'

You can see in 'Repository Branch' / 'Code Analysis' the info obtained from analysis rules.

Data creation in Github

You have the possibility to creates two items in Github directly from Odoo

• Teams:
• Go to 'Settings' / 'Create Team in Github'.
• Set the information and click on Create in Github.
• Odoo will try to create the team. If access right and datas are correct, the creation will be done directly in Github
• Later on, a synchronization will be performed, to create the according team in the Odoo instance.
• Repositories:
• Go to 'Settings' / 'Create Team in Github'.
• Set the information and click on Create in Github.

Note

Analysis in this module is basic: for the time being, it just gives branches size.

Nevertheless, you can develop an extra Odoo Custom module to extend analysis function and get extra statistics, depending on your needs.

In that way, you can see the module github_connector_odoo, if your repositories contain Odoo modules.

Reporting

This module provides several reports

Branches by Serie

Sizes by Serie

Repository branch analysis rule