DASH IF Conformance Versions Save

This repository provides the source code for MPEG-DASH/DASH-IF Conformance Software/Validator. It has been extended according to further standards, such as CMAF, DVB-DASH, HbbTV, and CTA WAVE.

v2.2.3

8 months ago

What's Changed

v2.2.2

11 months ago

Bugfixes

v2.2.1

1 year ago

Features

#654 Adds a state symbol for all test messages @Phencys

Bugfixes

#654 Fix issues in the CTA-WAVE testsuite leading to wrong parsing of media profiles and invalid period timing @Phencys @dsilhavy #646 Fix bugs causes by wrong variable names and missing references in the HbbTV testsuite @dsilhavy #650 Remove a false check for matrix coefficients leading to a wrong message @Phencys #651 Allow new logger initialization with set module and hook, used for low latency @Phencys #655 Fix a bug when merging higher level attributes into lower level attributes leading to missing information in the Representations @dsilhavy #647 Use HTML links in "About" and "FAQ" markdown of landing page @dsilhavy

v2.2.0

1 year ago

Features

#625 Refactor phase 2: Various bugfixes, optimization, removal of unused code @Phencys #610 Implemented a new frontend in plain JavaScript utilizing the new REST interface @FritzHeiden #620 Setup Github action to verify correct execution of CLI for each pull request @FritzHeiden #622 ISO Segment Validator Refactoring Part 1 @rbouqueau #626 ISO Segment Validator Refactoring Part 2 @rbouqueau #631 Add output of segment validation to JSOn result. @dsilhavy #635 #639 Enable text input and file upload @Phencys @FritzHeiden #641 Add new flag to disable/enable detailed segment validation output. Reduces the size of the resulting .json @dsilhavy

Improvements

#630 Add missing license files @dsilhavy #629 Adjust functional test scripts to include right dependencies based on #625 @dsilhavy #633 Update xsd to 5th edition @Phencys #642 Add profiles for autodetection of CMAF and CTA-WAVE @dsilhavy #643 Change wording of segment related checks @dsilhavy

Bugfixes

#618 Fix parsing error of resulting JSON in new UI @FritzHeiden #637 Fix a bug where stderr output would always be considered empty @Phencys #640 Fix segment validation results not displaying properly @FritzHeiden

v2.1.0

1 year ago

Features

#610 Add a new conformance frontend written in plain Javascript. The new frontend uses the new REST Interface to trigger testruns and derive test results. It is automatically deployed to a separate folder and available here: https://beta.conformance.dashif.org/Conformance-Frontend-JCCP/#home @FritzHeiden

Improvements

#616 Added a 30 second timeout / 60 second kill timeout on the segment validator, to prevent it from running indefinitely. @Phencys #616 Added a category "health" checks to the logger module, to provide information about various issues with the segment validator such as invalid XML files and timeouts @Phencys

v2.0.0

1 year ago

Features

#548 Add a Command Line Interface to run the tests directly from the command line instead of using the web interface. Multiple options available, see documentation @Phencys #606 Add a REST interface to trigger conformance tests and @Phencys #547 Support for running the Conformance Tools in Docker @aldafu Link Implement a dashboard for evaluation of the conformance validation and to derive line, method, function, class coverage for each of the testruns. Serves as an essential tool to identify parts of the code that are never executed due to missing test content and implementation errors. @dsilhavy

Refactoring

#548, #585, #606 Move all the tests of the existing modules to dedicated .php files and include them using module.php approach. Note this was a major refactoring step influencing the whole existing codebase. @Phencys #548 Move to a mono repository instead of including the required modules as Git submodules of the main repository. @Phencys #548 Implement a dedicated module.php for each of the submodules. Includes of the individual test files are done in these module files. @Phencys

Improvements

#548 Default verdict to PASS instead of a null value @Phencys #548 Add .gitignore file @Phencys Link Show commit hash on landing page @aldafu #591 Add support for DVB DASH 2017 @wschidol #606 Give an empty entry for hooks where no checks have been run. @Phencys #606 Move Dolby validation to separate module @Phencys #606 Add additional unit tests for CTA WAVE testcases @Phencys

Bugfixes

#606 Fix multiple typo errors leading to tests not being executed @Phencys #606 Remove files that are not being used @Phencys #606 Remove issues with case-insensitive filesystems @Phencys

Rationalize Programming Languages

#606 Removed Python as a dependency @Phencys #606 Move to php 7.4, prepare migration to php 8 @Phencys

CI/CD

#581 Add workflow to automatically deploy to beta and staging environment. Results are available at https://beta.conformance.dashif.org/ and https://staging.conformance.dashif.org/. Internally, the different versions are hosted on the same EC2 instance and run in dedicated Docker containers. @aldafu #584 Add support for automatic creation of doxygen documentation. Results are automatically uploaded to https://conformance.dashif.org @dsilhavy #582 Add support for automatic linting @aldafu #586 Add support for using phpunit to run the unit tests and generate HTML code coverage report. Results are automatically uploaded to https://conformance.dashif.org/unit-tests @dsilhavy DASH-IF CTA-WAVE HbbTV Add support for running manifest and segment validation for CTA WAVE, DASH-IF and HbbTV testvectors. Note that for HbbTV the segments are not publicly available, only automatic MPD validation is performed. @aldafu

Documentation

Link Add installation and setup guide including Troubleshooting Section @dsilhavy Link Add usage guide previously available in pdf format @dsilhavy @aldafu Link Establish development principles including Git branching strategy, pull request handling and documentation on Github actions @dsilhavy Link Add documentation how to use the command line interface @dsilhavy Link Add documentation how to release a new version of the tools @dsilhavy Link Collect a list of relevant specifications @dsilhavy Link Collect a list of relevant testvector URLs @dsilhavy [Link](https://github.com/Dash-Industry-Forum/DASH-IF-Conformance/wiki/REST-Interface] Document the usage of the REST interface @dsilhavy