Wholesale: Products & Services

Open System CR SCR063003-02 Detail

Description Of Change

Qwest to develop a test database that would allow CLECs to test Qwest’s IMA GUI before major and point releases are implemented. Because Qwest does not offer testing, the CLECs GUI users are faced with significant issues that impact our ability to submit LSRs to Qwest in the IMA GUI. Qwest assign’s severity codes as problems are identified through system trouble tickets, based on volume and CLEC impact. For example, in the 12.0 release, an edit was implemented to edit for alpha characters in the hunt sequence. However, there are alpha characters required for some types of hunt sequences and ported numbers. This had a significant impact to Eschelon, but not necessarily to the entire CLEC Community because of product set and EDI. Because Qwest views the impact as minimal, the fix will not be implemented until the 13.0 release. These situations happen with each release. If Qwest offered testing before releases, such as SBC (discussed in June CMP meeting) these issues could be identified and resolved before the release. The impact to CLECs LSR is significantly impacted without testing.

Expected Deliverables/Proposed Implementation Date (if applicable):

Qwest will develop a test database for the IMA GUI. This test database will allow CLECs to test the IMA GUI before major and point releases. The CLECs experience significant impacts to LSR submittal because Qwest does not have the ability to test.

Status History

Project Meetings

Lynn,

Since the LOA is larger than Qwest even allows for in a single release now, and we would need to reevaluate the CR and the LOA, you can place this CR in a deferred status for the time being.

Bonnie Johnson

Director Carrier Relations

Eschelon Telecom Inc.

Phone 612 436-6218

Fax 612 436-6318

Cell 612 743-6724

bjjohnson@eschelon.com

-

From: Stecklein, Lynn [mailto:Lynn.Stecklein@qwest.com] Sent: Tuesday, August 07, 2007 10:50 AM To: Johnson, Bonnie J.; Isaacs, Kimberly D. Subject: FW: SCR063003-02 Develop Test Capability in GUI

Hi Bonnie and Kim,

We are in the process of reviewing eligible candidates for the IMA 23.0 Release and have a question on the attached CR. Is there any change to the CR based on the e-mails below?

Thanks!

Lynn

-

From: Johnson, Bonnie J. [mailto:bjjohnson@eschelon.com] Sent: Wednesday, January 25, 2006 6:58 AM To: Stecklein, Lynn Subject: RE: SCR063003-02 Develop Test Capability in GUI

Lynn,

For the time being I would like it to remain. When we discuss the CRs for 20.0 prioritization as a group, I may choose to defer it.

Thanks,

Bonnie Johnson

Director Carrier Relations

Eschelon Telecom, Inc.

Phone: 612 436-6218

Fax:612 436-6318

Cell: 612 743-6724

--Original Message-- From: Stecklein, Lynn [mailto:Lynn.Stecklein@qwest.com] Sent: Tuesday, January 24, 2006 11:47 AM To: Johnson, Bonnie J. Subject: SCR063003-02 Develop Test Capability in GUI

Hi Bonnie,

We are in the process of compiling all the IMA 20.0 candidates. I have a question about SCR063003-02 (Develop Test Capability in GUI to Allow Testing Before Major and Point Releases). In February of 2005, you stated that you were working through other processes to accommodate this request. Do you still want this CR to remain on the IMA 20.0 candidate list? Let me know.

Thanks!

Lynn Stecklein

Qwest Wholesale CRPM

303 382-5770

This communication is the property of Qwest and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.

1/25/06 E-mail From Eschelon

Lynn,

For the time being I would like it to remain. When we discuss the CRs for 20.0 prioritization as a group, I may choose to defer it.

Thanks,

Bonnie Johnson Director Carrier Relations Eschelon Telecom, Inc.

Phone: 612 436-6218 Fax:612 436-6318 Cell: 612 743-6724

--Original Message-- From: Stecklein, Lynn [mailto:Lynn.Stecklein@qwest.com] Sent: Tuesday, January 24, 2006 11:47 AM To: Johnson, Bonnie J. Subject: SCR063003-02 Develop Test Capability in GUI

Hi Bonnie,

We are in the process of compiling all the IMA 20.0 candidates. I have a question about SCR063003-02 (Develop Test Capability in GUI to Allow Testing Before Major and Point Releases). In February of 2005, you stated that you were working through other processes to accommodate this request. Do you still want this CR to remain on the IMA 20.0 candidate list? Let me know.

Thanks!

Lynn Stecklein

Qwest Wholesale CRPM

303 382-5770

2/16/05 CMP Systems Meeting - IMA 18.0 Candidate Discussion

Bonnie Johnson-Eschelon stated that they we are working through other processes to accommodate this request. Bonnie requested that the CR remain open and that it is a low priority for Eschelon.

7/22/04 CMP Systems Meeting

Jill Martain/Qwest stated that Qwest would distribute the ballot on July 27th, it is due back to Qwest on July 30th, and Qwest would email the initial prioritization list to the CLECs on August 3rd. There were no questions. Kim Isaacs/Eschelon stated that this is a medium low for Eschelon due to the LOE and that other CRs address some of the issues as well.

3/19/04 CMP Systems Meeting

See AI021904-08 Testing Scenarios

Connie Winston/Qwest stated that we met internally and intend to meet again at the end of March. Connie said that once the internal meetings are held, we would schedule an adhoc meeting after 15.0 with the CLEC Community to discuss the testing scenarios.

2/19/04 CMP Systems Meeting

Connie Winston/Qwest discussed the 3rd item on the open issue tab of the project plan. Connie stated that we have talked off-line with Eschelon to discuss an alternative solution to SCR063002-03 Develop Test capability in GUI to allow testing before major and point releases. Connie stated that the test time is currently built into the LOE. Connie stated that we could begin by adding items the CLECs would like to see in regression testing. Connie said that we could look at examples such as blocking and hunting. Connie also stated that we could look at a small subset of scenarios and have an adhoc call to determine if the scenarios are those that the CLECs want tested. Connie stated that the tests would be marked as pass/fail and if the test does not pass, a CR would be created. Connie said that when you get this close to a release, we event notify that the release is going in with a bug. Connie said that this is not common but it does happen. Connie said that it would not be just for CLEC Test cases but all cases. Connie said that we would communicate on the CLEC Test cases if we were implementing the release with a bug Bonnie Johnson/Eschelon stated that she appreciates Qwest looking at alternative solutions to this CR. Connie Winston/Qwest stated that Qwest will schedule an adhoc call within the next two or three weeks.

8/21/03 CMP Systems Meeting

Connie Winston/Qwest stated that this request would require a GUI to mimic the SATE environment and that documentation would be updated. Connie stated that if this request is voted in, the release date will be moved out a month for the 15.0 Release because of the new process on the front end. Connie also noted that the other item around this request is that it will require quite a lot of resources to support the new environment. She stated that to support this new environment Qwest estimates that 10,500 hours would be utilized. These hours would be taken from the release hours going forward. Bonnie Johnson/Eschelon asked if Qwest currently draws from the total hours for SATE. Connie Winston/Qwest stated that the hours would be drawn from the IMA hours and the SATE hours are currently absorbed. Liz Balvin/MCI asked if the 10,500 hours is above and beyond what it would take to implement. Connie Winston/Qwest said that yes, the hours would be per release, initial implementation has it’s own LOE of 1250 to 2050 hours. Kit Thomte/Qwest asked if there were any other comments or questions. There were no other comments or questions.

Kim Isaacs/Echelon stated that this CR was the highest for them. Connie Winston/Qwest stated that the LOE for implementation was 1250 to 2050 and SATE hours of 2760 to 4600. She also stated again that the CR would require 10,500 out of every release.

7/10/03 Clarification Meeting

Introduction of Attendees Bonnie Johnson - Eschelon, Kim Isaacs - Eschelon, Sharon Van Meter - AT&T, Stephanie Prull - McLeod, Lynn Notarianni - Qwest, Pat Bratetic - Qwest, Lynn Stecklein - Qwest

Review Requested (Description of) Change Eschelon is requesting Qwest Develop test capability in the GUI to allow testing before major and point releases. Currently Qwest offers SATE testing for EDI, Qwest should offer similar testing in the IMA GUI. Pat Bratetic - Qwest asked if Eschelon could provide information on SBC's testing process. Bonnie Johnson - Eschelon stated that SBCs GUI releases are flash cuts and that they provide Eschelon the opportunity to have test data bases in LSR submission. Kim Isaacs - Eschelon stated that the GUI test window is open one month prior to the release date. Five test orders can be submitted a day. Test scenarios are developed and there is a daily conference call with your assigned point of contact during the testing period. Kim also stated that any identified defects are corrected prior to the release or there is a mutually agreed upon workaround. Kim stated that the daily calls are with individual CLECS and their assigned point of contact, not with the CLEC Community. Lynn Notarianni - Qwest asked when test cases needed to be submitted.. Kim said that the window is 1 week in advance. Pat Bratetic - Qwest asked asked if the test cases received FOCs or rejects. Kim said that test cases do receive FOCs. They do drop out of flow through and the SME in the center reviews to determine whether they could complete and process. Lynn N. asked what the process associated with defect tickets. Kim stated that the fix was done prior to the release and if there is a workaround everyone has to agree on the workaround. Lynn N. asked if a change had ever been backed out of a release and Kim said that no change was ever backed out of a release. Lynn N. said that the goal would be to keep with the schedule release. Lynn N. asked if Pre-Order and Order were impacted and Kim said yes. Lynn N. asked if this process was documented and Kim said that it is on the website as of approximately December 2000. Lynn N. asked if this was an optional and Kim said that it is optional and is similar to the EDI process. Pat B asked how many cases could be submitted per day and Kim stated that 5 per day could be sent and everything is reviewed daily.

Confirm Areas & Products Impacted It was confirmed that the interface impacted is the IMA GUI.

Identify/Confirm CLECs Expectation

Establish Action Plan Eschelon will present this CR in the August Monthly Meeting. Action item discussed in CMP Monthly Meeting- excerpt from June 19, 2003

AI050603-01 Testing in the IMA GUI (originated by Eschelon) Kit Thomte/Qwest stated that there have been some discussions and stated that a CR will need to be opened in order to change CMP language. Connie Winston/Qwest stated that a lot of time has been spent looking at this and stated that every option would be very expensive, to create a new environment. Connie stated that Qwest can offer a slightly longer window on Sunday and noted that fixes would need to be scheduled. Connie stated that Qwest does patches in the first week, when we can. Connie stated that there is a candidate in 14.0 that will create a table and should provide some relief. Connie stated that if we open the window, and put in that CR, there seems to be things we could work on that we would make the week after a release less painful. Connie stated that those are the options we could come up with without creating a new environment. Bonnie Johnson/Eschelon stated that she appreciates that it is a large effort, as Eschelon has just had a GUI upgrade with SBC. Bonnie noted that SBC does have a test environment that was very beneficial. Bonnie stated that part of the problem is with Event Notices, communication, and rejects. Bonnie stated that most things are fixed quickly. Bonnie stated that the problem in 12.0 applied a hunting edit so it would no longer accept an alpha character. Bonnie stated that this is an excellent example of people not talking to each other. Bonnie stated that for instance, HTZ is needed for circular hunting. Bonnie stated that there are cases where we got rejects using the workarounds. Bonnie stated that this is impacting to the business. Bonnie noted that the 12.0 problems did not get fixed until 13.0 and that is not acceptable. Bonnie stated that trouble ticket 56162 is because the CLECs have to mark for manual handling and then has to manually type the order. Bonnie stated that there needs to be some language around timelines, in getting defects fixed, so the CLECs don’t have to work manual processes for 6 month’s. Donna Osborne-Miller/AT&T stated that AT&T gives their support. Connie Winston/Qwest asked if details on SBC’s process could be provided, to better understand what you’re looking for. Kim Isaacs/Eschelon stated that the GUI test window is open one month prior to the release date, you develop test scenarios, and there is a daily conference call with your assigned point of contact during the testing period. Kim stated that any identified defects are corrected prior to the release or there is a mutually agreed upon workaround. Kim stated that the daily calls are with individual CLECS and their assigned point of contact, not with the CLEC Community. Sue Stott/Qwest asked if each CLEC provides test scenarios prior to the test. Kim Isaacs/Eschelon stated yes and stated that there are established dates. Kim stated that test accounts are then provided to the CLEC. Connie Winston/Qwest asked if it is a protected test environment. Kim Isaacs/Eschelon stated yes, there is a separate URL for the test database and you sign on with a test user id. Connie Winston/Qwest stated that a test environment has been discussed as a possible option because we cannot be in production environment for testing. Bonnie Johnson/Eschelon stated that it would be a large cost to Qwest, but asked if the benefits would outweigh the costs. Connie Winston/Qwest stated that Qwest can certainly look at that but it would require a CR. Bonnie Johnson/Eschelon stated that she would submit a CR. Connie Winston/Qwest stated that it would help to have the detail of what the expectations would be on a CR. Sue Stott/Qwest asked if the CLEC submits the test scenarios. Kim Isaacs/Eschelon stated yes, and stated that they have published dates as to when to submit those test scenarios, what the cutoff date is, and the date the scenarios are returned. Kim stated that the timelines are all outlined. Lynn Notarianni/Qwest asked if Eschelon could provide an idea of the volume of test scenarios. Lynn asked if it is typically a regression test, or a test of new functionality. Kim Isaacs/Eschelon stated that typically it is regression testing, but new functionality is also tested. Kim stated that there were 12 test scenarios in the past release with SBC. Connie Winston/Qwest stated that one scenario could touch several pieces of functionality. Kim Isaacs/Eschelon stated yes, that is correct. Connie Winston/Qwest stated that we would look for a systems CR to be submitted. Kit Thomte/Qwest stated that this action item would be closed upon receipt of Bonnie’s CR. There were no additional questions or comments.

CenturyLink Response

RE: SCR063003-02

Qwest has reviewed the information submitted as part of Change Request SCR063003-02. Based upon the scope of this CR as agreed to in the Clarification Meeting (held July 10, 2003) Qwest is able to provide an estimated Level of Effort (LOE) of 1250 to 2050 hours for this IMA Change Request and no SATE impacts..

At the August Systems CMP Meeting, CMP participants will be given the opportunity to comment on this Change Request and provide additional clarifications. Any clarifications and/or modifications identified at that time will be incorporated into Qwest’s further evaluation of this Change Request.

This Change Request is eligible for the IMA 15.0 Prioritization.

Sincerely, Qwest

DRAFT RESPONSE

8/14/03

RE: SCR063003-02

Qwest has reviewed the information submitted as part of AT&T's Change Request SCR063003-02. Based upon research that has been conducted following the Clarification meeting (held July, 10, 2003) Qwest is still examining the issue. Qwest will continue to research the problem and provide an updated response at the August Systems CMP Meeting.

At the August Systems CMP Meeting, CMP participants will be given the opportunity to comment on this Change Request and provide additional clarifications. Qwest is interested in the experiences of the CMP community as relates to this issue. Qwest will incorporate any feedback received into further evaluation of this Change Request.

Sincerely, Qwest