| |  | h2. Software Testing Focus Group Meeting Notes: 08/29/2007 |
| | |
| | |
| | h3. Attendees |
| | |
| | Mitch DeRidder, Kerry Lamb, Mary Syre, Frank Williston |
| | |
| | |
| | h3. What's Next? |
| | |
| | The next meeting will be a lunchtime (probably brown bag) 'lessons learned' review. We'll try to get everyone who has participated in the focus group in the past to attend (including Joe) and from that determine what the next steps should be. |
| | Mary & Kerry will meet and plan the review (see actions). |
| | |
| | |
| | h3. Action Status |
| | |
| | Completed: |
| | * _Mary_: Contact Rick Ells and see if he'll agree to be listed as a resource on the main page. He agrees. |
| | * _Kerry_: Post instructions on how to restore DMS II data from production into a test environment (using procedures from the TestBed project). |
| | ** 8/28 Status: Ready for review on TestBed page; link to HRP docs:https://docs.cac.washington.edu/hepps/production-support/development/Rollpoint.doc/view?searchterm=rollpoint |
| | * _Kerry_: Post procedures used during the TestBed project to do the risk analysis and determination of what to test. |
| | ** 8/28 Status: Ready for review on TestBed page:https://wiki.cac.washington.edu/x/-gVB. |
| | * _Unassigned:_ Have someone from the Testing Focus group get involved in the Team Server Focus Group, or have someone from the team server group join the testing group. |
| | ** 8/29 Status: May is nominally in both groups, so this action may be completed. |
| | |
| | In Progress: |
| | * _Frank_: Pull together procedures for using the DFDS transaction record/playback functionality. |
| | ** 8/29 Status: Some progress but more information from MDSS is needed (in addition to what's in the DFDS documentation). |
| | * _Kerry_: Pull together procedures for using the audit file comparison tool (used for COBOL85 regression testing). |
| | ** 8/29 Status: Doug Dobson is taking this on as part of the Mainframe Developer Tools focus group (he wrote the tool). |
| | * _Kerry_: Provide the results of the testbed project post-production study of bugs found in production (how many and what types of problems were found in areas with what types of test coverage?). |
| | ** 8/29 Status: Almost all the bugs have been captured in TestTrack; study has started but won't be complete until later in the fall. |
| | |
| | Not Started: |
| | * _Unassigned (was Joe)_: Post instructions on how to restore SQL data from production into a test environment. |
| | ** 8/28: Anyone want to take this on? |
| | |
| | h3. Next meeting |
| | |
| | TBD: Lessons Learned review to be scheduled |
| | |
| | h2. |
| | |
| | |
| | h2. Software Testing Focus Group Meeting Notes: 06/18/2007 |
| | |
| | |
| | h3. Attendees |
| | |
| | Mitch DeRidder, Kerry Lamb, Mary Syre |
| | |
| | h3. Administrative |
| | |
| | The May 22nd meeting was canceled. |
| | Joe has moved to another organization and is no longer participating in this group. |
| | |
| | h3. New Web Site |
| | |
| | We briefly reviewed the nile site and decided to include an 'invitation to join' instead of adding everyone in OIM as a member. The www pages are still functioning. |
| | _Action All: Review the nile site by 6/26/07 and let Kerry know if there are any issues:_ |
| | [https://docs.cac.washington.edu/cac/swtesting] |
| | _We'll put a redirect on the www pages and send notification out about the new location._ |
| | |
| | h3. Action Status |
| | |
| | Review of actions that came out of the DAWG and MDC presentations: |
| | |
| | Completed: |
| | * Kerry: Put the timeline link on the main Testing Best Practices page. |
| | * Kerry: Dig up existing documentation for DFDS transaction record/playback functionality (used for COBOL85 regression testing) and pass to Frank. |
| | |
| | In Progress: |
| | * _Mary (was Unassigned)_: Contact Rick Ells and see if he'll agree to be listed as a resource on the main page. |
| | * _Kerry_: Post instructions on how to restore DMS II data from production into a test environment (using procedures from the TestBed project). |
| | * _Kerry_: Post procedures used during the TestBed project to do the risk analysis and determination of what to test. |
| | * _Frank (in absentia)_: Pull together procedures for using the DFDS transaction record/playback functionality. |
| | * _Kerry_: Pull together procedures for using the audit file comparison tool (used for COBOL85 regression testing). |
| | |
| | Not Started: |
| | * _Kerry (was Unassigned)_: Have someone from the Testing Focus group get involved in the Team Server Focus Group, or have someone from the team server group join the testing group. |
| | * _Unassigned (was Joe)_: Post instructions on how to restore SQL data from production into a test environment. |
| | * _Kerry_: Provide the results of the testbed project post-production study of bugs found in production (how many and what types of problems were found in areas with what types of test coverage?). (This won't be ready until after 6 months of data collected, sometime in August.) |
| | |
| | h3. Next meeting |
| | |
 |  | Tuesday, July 10, 2007, 11:00 am to 12:00 pm, Location: Conf - 4545 Basement |
| | | Tuesday, July 10, 2007, 11:00 am to 12:00 pm, Location: Conf - 4545 Basement (Canceled) |
| | |
 | | |
| | h2. Software Testing Focus Group Meeting Notes: 04/17/2007 |
| | |
| | Attendees: Mitch DeRidder, Joe Frost, Kerry Lamb, Joseph Lee, Mary Syre |
| | |
| | We discussed the feedback from the MDC presentation (held on 4/11). Some of the key areas MCP developers were interested in: |
| | * How to restore data from production into test (this brought a comment that a dump of input and output messages). |
| | * Environment Independence (so that what is moved into production is what was tested). |
| | * How to build code so that it's testable? (This brought a comment that the newest version of the email system utility will allow programs to pull email addresses from a file.) |
| | * Code Preview (Design Review) |
| | |
| | There was also a discussion about when to spend the time testing, and the use of doing a risk analysis to determine the amount of testing to do. Actions that came out of the DAWG and MDC presentations: |
| | * Put the timeline link on the main Testing Best Practices page. (Done) |
| | * _Unassigned_: Contact Rick Ells and see if he'll agree to be listed as a resource on the main page. |
| | * _Unassigned_: Have someone from the Testing Focus group get involved in the Team Server Focus Group. |
| | * _Joe_: Post instructions on how to restore SQL data from production into a test environment. |
| | * _Kerry_: Post instructions on how to restore DMS II data from production into a test environment (using procedures from the TestBed project). |
| | * _Kerry_: Post procedures used during the TestBed project to do the risk analysis and determination of what to test. |
| | * _Kerry_: Provide the results of the testbed project post-production study of bugs found in production (how many and what types of problems were found in areas with what types of test coverage?). |
| | * _Kerry_: Dig up existing documentation for DFDS transaction record/playback functionality (used for COBOL85 regression testing) and pass to Frank. |
| | * _Frank (in absentia)_: Pull together procedures for using the DFDS transaction record/playback functionality. |
| | * _Kerry_: Pull together procedures for using the audit file comparison tool (used for COBOL85 regression testing). |
| | |
| | Since we are asking for more participation and input from outside the Focus Group, the team decided we wanted to move the Best Practice pages to a nile site which will support collaboration. Kerry took at action to submit the request. |
| | |
| | Next meeting: _Tuesday, May 22, 2007 Time: 10:00 am to 11:00 am Location: 4545 Basement_ |
| | |
| | h2. Software Testing Focus Group Meeting Notes: 03/13/2007 |
| | |
| | Attendees: Mitch DeRidder, Joe Frost, Kerry Lamb, Mary Syre We continued working on the presentation to be given at the DAWG and MDC. |
| | The DAWG presentation is scheduled for March 20, and the MDC presesntation for April 11. |
| | |
| | See [Focus Group Status presented at the March 20th DAWG|FilesFolder^Testing070226.ppt] |
| | |
| | Next meeting: _Tuesday, March 20, 2007 Time: 11:00 am to 12:00 pm (DAWG) Location: 4545 Basement_ |
| | |
| | h2. Software Testing Focus Group Meeting Notes: 02/20/2007 |
| | |
| | Attendees: Mitch DeRidder, Joe Frost, Kerry Lamb, Mary Syre |
| | |
| | The feedback from the senior managers has prompted us to change directions a bit. |
| | Rather than issue a survey at this point, they would like us to prepare a short presentation (15 minutes or so) to explain our research and web pages to DAWG, MDC, Managers and Leads, and some OIM teams. |
| | |
| | Today's meeting was used to discuss what an introductory slide show might contain. The focus is on 'how to get testing done at a grass roots level'. We want to share info and get input, and get a feel for the level of knowledge (and the level of resistance) among the developers. |
| | |
| | Once we have presented this at several teams, we should consolidate the feedback into a presentation for the Managers and Leads meeting, identifying areas to improve and existing best practices. |
| | |
| | We decided the presentation should be in chronological order: what we've done, what do we want to do? what do we want others to do? The target for the start of presentations is this time next month, so we'll meet more often to work through the presentation. |
| | |
| | Next meeting: _Tuesday, March 13, 2007 Time: 2:30 pm to 3:30 pm Location: 4545 3rd Floor_ |
| | |
| | h2. Software Testing Focus Group Meeting Notes: 01/24/2007 |
| | |
| | Attendees: Joe Frost, Mary Syre, Kerry Lamb, Joseph Lee, Mitch DeRidder |
| | |
| | Reviewed the survey introduction draft. It was suggested that consistent formatting is desirable. Especially, changing the format so that either all the bullets should be in the format of "Title: sentence using title," or "Title: Title in definition." |
| | |
| | Our target audience for the survey is the staff of OIM, which we may expand to TEG in a second phase. An advantage of a phased distribution is that we can revise the survey if the results show a need for it. We do not expect to spread the message to the University as a whole. |
| | |
| | We will take the next draft to a meeting of upper management. Joe will arrange with Marcy to schedule that. |
| | |
| | We are looking for support on using the survey and on the "remediation" that it may point to. The next step depends on the results of the survey. If there is strong interest in a particular topic or topics, we will want to schedule classes or seminars about that topic. If response is weak or lukewarm, we will need to do more selling of the advantages of testing before we schedule classes or seminars. We may also want to provide some support for pilot usage of some of the techniques, as a practical demonstration of their worth. |
| | |
| | Mary will edit the current draft, then pass it to Mitch. When complete, the list items will replace the similar list items on our main web page. |
| | |
| | Next meeting: _Tuesday, February 20, 2007 Time: 10:00 am to 11:00 am Location: 4545 3rd Floor_ |
| | |
| | h2. |