I would like to ask for suggestion about tools released on github.com/DMTF. The situation we are facing now is many of our customers always require us to run most tools on DMTF github so I would really need your help to see if it's possible to provide a tool list that all Redfish developers shall run on their product as quality assurance. Most of our customers treat the reports / logs generated by DMTF tool as official certification.
This tool is focused on the JSON payload and schema conformance. Start your testing here as data/payload errors are more likely to cause interoperability issues for end users. This tool uses the Redfish Python library, so "critical" protocol issues may prevent it from running to completion. If so, swap the order of your testing.
This tool is focused on the HTTP protocol conformance, checking headers, response codes and other protocol functions. While many of the issues it detects may not directly impact end users or simple scripts, they will contribute to interoperability issues with more sophisticated client software and automation tools.
Both of these tools are actively maintained by DMTF personnel. If you encounter issues with either tool. please open issues on GitHub. Note that both tools have been run on numerous implementations, so anything that crashes the tool very likely indicates an issue with the implementation (as well as something we should catch). We may ask that you attach the log file created with the "--debugging" option. Pull requests for enhancements or bug fixes are also welcome!