Rewrite of bosh-gen package --apt to perform the fetch of debian packages during package compilation, rather than assume Vagrant etc.

This idea "works" even better if you are shipping pre-compiled BOSH releases to your users; therefore only you/your CI performs the Debian package fetching, not the end users.

UPDATE: bug fix in v0.101.1

Rewrite of bosh-gen package --apt to perform the fetch of debian packages during package compilation, rather than assume Vagrant etc.

This idea "works" even better if you are shipping pre-compiled BOSH releases to your users; therefore only you/your CI performs the Debian package fetching, not the end users.

Generated manifest assumes xenial stemcells. Bumped bpm to 0.12.3.

• job spec files include dependencies [fixes #107] (#108)
• if 'package --src somedir' then glob is 'somedir/**/*' [fixes #105] (#106)
• detect if package is a language-pack and source compile.env (#104) - see https://github.com/bosh-packages
• update to bpm v0.5.0

From now on, new bosh-gen job will use https://github.com/cloudfoundry-incubator/bpm-release to run jobs within containers. These job folders are a lot simpler to understand and have a lot less cruft generated to manage pid files etc.

Watch https://www.youtube.com/watch?v=N4fZ4a-9Mqs&list=PLhuMOCWn4P9hsn9q-GRTa77gxavTOnHaa&index=73 to learn more about bpm (previously called crucible) from CF Summit EU 2017 in Basel.

To generate the original, non-bpm job templates use --no-bpm flag.

• extract-job and extract-pkg commands use bosh add-blob for blobs
• extract-job and extract-pkg commands correctly glob for many files across both src/ and blobs/ directories
• If bosh2 is installed then it is used; else assumes bosh is the latest bosh2 CLI

Please uninstall old bosh_cli rubygem:

gem uninstall bosh_cli

gem install bosh-gen will no longer install old bosh_cli gem and its old bosh CLI.

This release is the first that moves towards supporting bosh2 CLI, both its required project files/schema and ultimately to use bosh2 for some bosh-gen commands.

Ongoing tickets are grouped at https://github.com/cloudfoundry-community/bosh-gen/projects/1

Changes in v0.90.0

Required for bosh2

• config/private.yml schema changed

Style/lint changes

• single manifest that "just works", rather than templates/make_manifest to merge several part files together. Generated stub manifests/thing.yml should be updated as you develop your release to always deploy a useful working system. bosh2 deploy manifests/thing.yml should "just work" please.
• ctl for name of job monit control script

Removed

• bosh1 ruby plugin - bosh2 is written in golang and does not support plugins; I'm unsure how much this plugin was used; but if it was then it needs rewriting
• old specs + .travis.yml for testing generators; instead we'll look at having integration tests via CI
• data/properties.sh template - it wasn't a pattern that was being adopted

v0.24.0

• Added new forge command to generate new forges for blacksmith. Thanks @jhunt

Thanks to James Hunt, Quintessence Anx, and Long Nguyen for this version!

• Fixed stemcell URLs from bosh public stemcells to https://bosh.io
• Randomize Warden Network definitions so they don't always clash
• Unify stdout/stderr log files everywhere
• Fixed issue where dir cpi was found as warden_cpi' notwarden'