This page provides a list of tests where we strongly recommended that you perform before each CET major and minor release. Please note that these are guidelines for a smoke test, not a regression test.
If you are coming from CET 12.0 onwards, we have introduced a split of 3 different industries [Commercial Interiors, Kitchen & Bath, Material Handling]. With this, we recommend to start by only turning on the relevant edition license before beginning smoke test. If you carry 'CET Developer' license, the edition licenses can be switched off via Developer Center in MyConfigura.
Automated Testing
We recommend that you run automatic tests on your extension. To help with this CET Developer provides some of the different automatic test functionalities that you can employ:
Use the following automation tools found in the QA Tools extension:
- PDF Diff
- Order Export Diff
- Batch Load
Insert All Snappers
- Use the Insert from Current Toolbox button in the Release Debug Dialog (Ctrl+Alt+Shift+F12)
- Make sure the snappers are visible in 2D and 3D without any crash.
Manual Testing
The idea behind the manual testing is to simulate a real use case, by drawing the same scene for each release.
We recommend that you record the test (for example using screen recording tools called "Screenpresso" or "ShareX"). This makes it easier to repeat the exact same test for upcoming major releases.
By doing this you will:
- Detect new bugs and crashes.
- Find quality improvements and new quality issues:
- Is it easy to draw your test case drawing?
- Has anything changed? (Better or worse than the previous release?)
Real User Scenario Smoke Test Guidelines
-
Installation and Update Test
- Using a used/clean machine, get the latest CET installer from MyConfigura, make sure it installs well and most importantly, all relevant extensions can be installed and used.
- Test if updating from older versions of CET (eg: 9.0, 10.0, 11.5) works by receiving updates to the latest possible version.
- Check these after installing CET with your extensions.
- Catalogues download automatically.
If your customers are always installing your extensions with other extensions, please make sure your extensions are compatible with those extensions too. If you have any questions regarding testing, please post your question in the Quality Assurance Forum. -
Create a basic manufacturer drawing by using these functionalities:
- Connect several symbols to each other to form a group
- Animation: placing, stretching, snapping, rotate, moving, etc.
- Single select, Multi-select, Rectangle select, Lasso select.
- Copy, paste, and cut
- Create blocks and Component Blocks (if applicable)
- Create Alternatives
- Use replicate tool (Polar, Linear, and Rectangle.)
- Create Multi-floor. Check to place Symbols on different floors.
- Turn on multiple drawing function. Check that you can work with multiple drawings at once.
- Attach dimension tools to symbols.
- Enter project information.
-
Once the drawing is completed, perform these tests:
- Change the quick properties and animation properties for a few symbols
- Check that the 2D and 3D graphics are correct (E.g. length, color, shape, etc.)
- Undo and Redo
- Change material on some symbols using Material Explorer
- Change material on some symbols using Schemes
- Freeze and unfreeze some symbols
- Group and ungroup some symbols
- Remove some symbols from the drawing
- Create and load favorites
- Tag a few symbols
- Lock and unlock symbols.
- Check that the Categories are present and correct
- Check that prices are visible in the Calculation dialog
- Use order export functionality in the Calculation dialog. Do a quick check for making sure the export works fine
- Render your drawing, both through Quick Render and from within the Photo Lab
- Generate Elevations (E.g. panel elevation, basic elevation, etc.)
- Create a picklist, save, load, edit, save and load again
- Switch between view modes
- Switch between different Filter and Visibility settings
- Paper view: create 2D and 3D viewports and make sure your symbols are visible in the viewports
- Generate auto papers
- Print Preview, Print and create PDF
- Save the drawing, load, edit, and then save and load again
- Export drawing
- Check that the extension’s icons, labels, and tooltips still look correct
Switch to different languages if the extension supports multiple languages
- Check that the performance is not worse than the previous version
Use the Response Monitor and Model Performance tool to help with testing
-
Test loading old test data created from previous CET versions
- Drawings (.cmdrw)
- Favorite files (.cmfav)
- Paper (.cmppr)
- Schemes (.cmScheme)
Migration Testing
Please run the migration testing by referring to the latest QA Testing Guide.
Links that may come handy to you:
Comments
0 comments
Please sign in to leave a comment.