|
Post by AMI_Caffrey on Apr 13, 2022 2:18:33 GMT
Hi, I would like to ask for suggestion about tools released on github.com/DMTF. The situation we are facing now is many of our customers always require us to run most tools on DMTF github so I would really need your help to see if it's possible to provide a tool list that all Redfish developers shall run on their product as quality assurance. Most of our customers treat the reports / logs generated by DMTF tool as official certification. Many thanks. BR, Caffrey
|
|
|
Post by jautor on Apr 13, 2022 21:30:27 GMT
The two conformance tools that every developer / QA team should run against their implementation are: Redfish Service Validator - github.com/DMTF/Redfish-Service-ValidatorThis tool is focused on the JSON payload and schema conformance. Start your testing here as data/payload errors are more likely to cause interoperability issues for end users. This tool uses the Redfish Python library, so "critical" protocol issues may prevent it from running to completion. If so, swap the order of your testing. Redfish Protocol Validator - github.com/DMTF/Redfish-Protocol-ValidatorThis tool is focused on the HTTP protocol conformance, checking headers, response codes and other protocol functions. While many of the issues it detects may not directly impact end users or simple scripts, they will contribute to interoperability issues with more sophisticated client software and automation tools. Both of these tools are actively maintained by DMTF personnel. If you encounter issues with either tool. please open issues on GitHub. Note that both tools have been run on numerous implementations, so anything that crashes the tool very likely indicates an issue with the implementation (as well as something we should catch). We may ask that you attach the log file created with the "--debugging" option. Pull requests for enhancements or bug fixes are also welcome! In addition, developers can utilize the "Use Case Checkers" to evaluate the implementation of specific functional portions of the schema/protocol. github.com/DMTF/Redfish-Usecase-CheckersThanks for the great question - it also reminded me that we should add some developer/debugging recommendations to the GitHub readme text as well. Jeff
|
|
|
Post by AMI_Caffrey on Apr 14, 2022 2:20:15 GMT
Glad to help!  Thank you so much for the valuable recommendation. Caffrey
|
|