This directory contains the ChatOps scripts, based on Hubot. It uses RocketChat and gitlab as the underlying framework (but can be modified to fit any other framework).

This document describes the goal of the scripts, as well as installation instructions and their basic usage.

Workflow

Scripts are ordered by workflow, not alphabetically. The workflow consists of

setting up a repository for a quote with the PenText framework
(optional: converting quickscope input to a quote)
building a PDF quote
setting up a repository for a pentest with the PenText framework, based on a quote
(optional: converting gitlab issues to XML findings and non-findings)
(optional: validating a PenText report)
building a PDF report
building a PDF invoice

Naming

The scripts either take the project name as input, or the repository name (and optional namespace and branch). The project name is leading, repository names are derived from the project names: the quotation repository has off- as prefix, and the pentest repository will have pen- as prefix. As a rule of thumb, the handlers that are prefixed with start (startquote, startpentest) will take the project name as input. All other handlers take the repository name as input.

Example: when the project's name is ros, then the corresponding quote repository and RocketChat channel's name will be off-ros. If this quote will result in a pentest project, then the corresponding repository and RocketChat channel will be named pen-ros.

Note that git repository names are lowercase.

Scripts

The scripts use multiple environment variables, that can be set by the user under which rosbot is running. These are

GITLABCLI :: the location of the python-gitlab command line interface (defaults to gitlab)
GITSERVER :: the name of the gitlab server (defaults to gitlab.local)
GITWEB :: the URL of the gitlab webinterface (defaults to https://$GITSERVER)
NAMESPACE :: the namespace of the user which is used to set up gitlab repositories (defaults to ros)
PENTEXTREPO :: the location of the PenText repository (defaults to https://github.com/radicallyopensecurity/pentext)

Prerequisites

python-gitlab

The Bash scripts use the python-gitlab command-line interface to talk to the gitlab instance. This interface can be installed using sudo pip install git+https://github.com/gpocentek/python-gitlab. Obviously, Python needs to be installed as well. This command line interface expects a configuration file .python-gitlab.cfg for the user under which rosbot is running, which it uses to connect to gitlab. Make sure it contains the correct details so that you can connect to gitlab.

If you want to convert and build documents, the pentext toolchain is necessary. Use the Ansible playbook https://galaxy.ansible.com/PeterMosmans/docbuilder/ or install the tools (Java, Saxon and Apache FOP) by hand, see https://github.com/radicallyopensecurity/pentext/blob/master/xml/doc/Tools%20manual.md for more information.

Python libraries

Pandoc is necessary in order to automatically convert gitlab issues written in markdown to XML format. The pypandoc library is also necessary: sudo pip install pypandoc.

Test the configuration

Test out whether the configuration is successful by manually executing the Bash script bash/test_pentext - this should return an OK.

CoffeeScript

rosbot.coffee

scripts/rosbot.coffee - contains the various keywords and redirects to the proper handlers. All RocketChat-specific actions (e.g. the creation of rooms) is being handled by this script.

The scripts contains an array of users that will be added to the newly created rooms by default.

Example: admins = ['admin']

Bash

startquote

Start the quotation process by setting up a repository with the PenText framework, and creating a RocketChat channel.

Handled by bash/handler_quote

Sets up a pentest RocketChat channel named off-PROJECT_NAME, a gitlab repo named off-PROJECT_NAME, and installs the latest version of the Pentext framework. Note that this uses the PROJECT_NAME as input, so it will automatically append the off- prefix.

Usage: startquote PROJECT_NAME

quickscope

Converts a quickscope (source/quickscope.xml) into a full-blown XML quote.

Handled by bash/handler_quickscope

Usage: quickscope REPO_NAME [NAMESPACE [BRANCH]]]

build

Builds PDF files from XML quotes and reports.

Handled by bash/handler_build

Usage: build quote|report REPO_NAME [NAMESPACE [[BRANCH]] [-PARAMETERS]

startpentest

Start the pentesting process by setting up a repository with the PenText framework, adding standard gitlab labels and issues, and creating a RocketChat channel.

Handled by bash/handler_pentest

Sets up a pentest RocketChat channel named pen-PROJECT_NAME, and a gitlab repo named pen-PROJECT_NAME. Will use the quotation found in the corresponding off-PROJECT_NAME as base. Note that the prefix pen- is set by the rosbot.coffee script.

Usage: startpentest PROJECT_NAME

convert

Converts gitlab issues labeled with finding and non-finding into XML files, and adds those to the repository Handled by bash/handler_convert

Converts gitlab items to XML findings

Usage: convert REPO_NAME

validate

Validates quotes and reports. Handled by bash/handler_validate

Validates quotes and reports using the validate_report.py script (proper casing, spell checking, long lines, cross-checks)

Usage: validate [OPTIONAL PARAMETERS]

invoice

Builds PDF invoices from quotes.

Handled by bash/handler_invoice

Usage: invoice REPO_NAME INVOICE_NO [NAMESPACE [[BRANCH]] [-PARAMETERS]