The DCN/ICN pilot program testing environment includes the pilot program, local area network sites, the Internet and the DCN/ICN Management Operations Control Center (MOCC).
The environment for testing includes both a Local Area Network (LAN) client/server environment (shown in Figure 1.2-2), and a Wide Area Network (WAN) with clients at Pilot Program Sites and other remote sites connected to the Internet to access servers located at the MOCC. As part of the pilot program test planning environment, we conducted a risk analysis; identified test levels and a test strategy; identified specific test methods, participating organizations, facilities, personnel and equipment; and developed a top level test schedule.
A preliminary risk analysis of the DCN/ICN has identified three risk areas related to the provision of information and collaboration services to DCN/ICN pilot program participants:
· Security.
· Performance.
· Information Content Accuracy and Currency.
Appendix C summarizes the security risk analysis and the corresponding Security Architecture to mitigate the security risks. Reference [DCN/ICN, 96d] documents an earlier DCN/ICN security analysis that was used in formulating our Security Architecture. Appendix C, Performance Requirements, in reference [DCN/ICN, 96a] documents our initial risk analysis of the Internet network performance.
Information content accuracy and currency are vital to the information services of the DCN/ICN. We conducted a risk analysis as part of the DCN/ICN information services requirements analysis, following the ManTech-WVA TAOC Software Process Planning Guidebook, and summarized this analysis in Figure 2.2-1. We then conducted a more detailed risk analysis related to test planning as shown in Figure 2.2-2.

Figure 2.2-1 Software Requirements Process Model

Figure 2.2-2 Software Test Phase Process Model
Table 2.2-1 DCN/ICN Information Services and Content Sources
Service Identifier |
Service Name |
Service Description |
Product Class |
Information Content Source |
SVC100 |
General |
Develop a common Graphical User Interface (GUI) for providing the following user services and that is capable of launching local applications and remote applications to whichever execution has been authorized. |
User Interface |
MOCC |
SVC700 |
Training |
Provide end-user training to set up and use the DCN/ICN services. |
Windows/ HyperText Markup Language (HTML) Help Tools |
MOCC, Commercial Off-the-Shelf (COTS) Help Systems |
SVC400 |
Calendar of Events |
Provide and maintain a calendar of CALS events noting upcoming worldwide conferences, workshops, expositions, along with contact information for programmatic or technical information. |
Database Content |
Information Content Providers |
SVC200 |
Organizations |
Provide and maintain an International CALS White Pages Directory of CALS and CALS related organizations, with brief mission statements, and links to technical and program points of contact. |
Database Content |
Program Management Offices Commercial Organizations with CALS Working Groups |
SVC800 |
Information Services |
Provide and maintain a smart search tool to locate information entities (text, graphics, audio, video) anywhere on the Internet. |
Smart Information Miner |
MOCC |
SVC1300 |
Specialists |
Provide and maintain a registration system and searchable directory of CALS, weapon system acquisition, engineering, manufacturing, logistics, management, operations and maintenance, training, and CALS technology specialists. |
Database Content |
Government and Commercial Organizations with CALS experts |
SVC300 |
CALS Initiatives |
Provide and maintain a directory of CALS Project Initiatives with on-line project descriptions and hyperlinks to initiative (CALS Activities at the national and international level) home pages. Initial CALS Initiatives include DoD CALS, North Atlantic Treaty Organization (NATO) CALS, UK CALS, SWEDCALS. |
Database Content |
CALS Organizations Points of Contact; Internet Home Pages |
SVC1000 |
Standards |
Provide on-line full text and abstracts for all CALS and CALS related standards and specifications as well as hyperlinks to other repositories containing specifications and standards (e.g., International Organization for Standardization (ISO) Repository). |
Database Content |
CALS Organizations Points of Contact; Internet Home Pages |
SVC1100 |
Publications |
Provide directories and hyperlinks to CALS and other repositories containing standards, technical information, reusable software, and publications related to CALS Functional Areas (Acquisition, Engineering, Manufacturing, Logistics, Testing, Operations and Support). |
Database Content |
CALS Organizations Points of Contact; Internet Home Pages of Government, Organizations and commercial domains |
SVC1200 |
Implementation |
Provide hyperlinks to CALS infrastructure implementations for public events, points of contact, and other publicly available information about the implementation (Pilot Programs or other CALS related activities at the weapon system or program management level). |
Database Content |
CALS Organizations Points of Contact; Internet Home Pages |
SVC600 |
Technologies |
Provide and maintain hyperlinks to sites with electronic technology research, commercial products and technical information (e.g., Frequently Asked Questions). Provide access to Electronic Commerce Resource Center (ECRC) and other Research and Development (R&D) Organizations. Provide access to Advanced Research Projects Agency (ARPA) based research project summaries. Provide access to digital libraries. |
Database Content |
CALS Organizations Points of Contact; Internet Home Pages of Government, Organizations and commercial domains |
SVC1400 |
Partnership Search |
Provide a method for a user to discover a business's capabilities and interest to team for a specific weapon system request for proposal or development. Provide an index and search capability of current virtual corporations working on a specified weapon system development program. Provide an index of current weapon system development programs. |
Database Content |
CALS Organizations Points of Contact; Internet Home Pages of Government, Organizations and commercial domains |
SVC1900 |
Electronic (Web) Publishing |
Provide an electronic publishing service for organizations or individuals that do not have organic electronic publishing capabilities. |
Database Content |
Customers |
SVC1700 |
Dissemination Service |
Provide a user-selectable information filtering service that filters information according to a user-defined profile. |
Database Content |
Customers |
SVC1500 |
Test and Certification |
Provide and maintain test and certification software directories for compliance testing to CALS and international standards used by CALS. |
Database Content |
CALS Organizations Points of Contact; Internet Home Pages of Government, Organizations and commercial domains with Test and Evaluation Standards/ test suites |
An information content source will be recorded in the information services database along with the date of last update for each record in each table.
Verification of content will be conducted with the information content source summarized in Table 2.2-1 by any of the following methods:
· On-line Registration of Information by Point of Contact.
· Electronic Mail from Point of Contact.
· Facsimile from Point of Contact.
· Periodic Inspection of Internet Uniform Resource Location (URL) of Information Source.
MOCC operations personnel will verify the currency of information by contacting the points of contact for each information source. MOCC operations personnel will verify the accuracy of hypertext links through web site management tools that check hypertext links.
Overall implementation/testing strategy consists of a building block approach which first provides core services such as Electronic Mail (E-Mail), E-Mail directory services, electronic discussion groups, document conferencing/annotations, and repository directories. The types and levels of services to be provided are shown in Figure 2.3-1.

Figure 2.3-1 DCN/ICN Types and Levels of Service
Core services testing will begin with a single DoD Pilot Program site (NSWC CD; Bethesda, MD) with local and remote users. Client workstations shall be qualified for DCN/ICN Pilot Program use by checking candidate workstations with a DCN/ICN qualification matrix shown in Appendix A. A site survey assessment shall be performed prior to pilot program initiation at a site using a site survey assessment tool included in Appendix B. Test strategies include: positive and negative test strategies; black box testing for COTS configuration items; and black and white box testing for Developmental Items (DEV) as well as Dynamic and Static testing for DEV items as summarized in Figure 2.3-2.

Figure 2.3-2 Test Strategies for COTS and Developmental Items
DCN/ICN test methods include the following:
· COTS/Developmental Item Configuration Item Tests within the MOCC Environment.
· Functional Tests by DCN/ICN Service Area.
· Interface Tests (e.g., Web Client and Web Server; Web Server and Oracle Relational Database).
· Performance Tests for Multi-Media Collaboration Services (e.g., audio, desktop video, text, chat, guided web navigation).
· Pilot Program Site User Comments and feedback via Help Desk and DCN/ICN Test Newsgroup.
2.5 Participating Organizations
The pilot program participating organizations and personnel include the following:
· Pilot Program Organization such as a DoD Program Management Office (e.g., NSWC, CD).
· Authorized Support Contractors/Consultants (independent systems/software engineers).
· DoD CALS Office (observers).
· CALS/IDE Virtual Enterprise MOCC Installation and Test Personnel.
The facilities for the DCN/ICN include facilities for local operations control centers at subscriber organization sites (multiple users) as well as the MOCC facility. A detailed description of the MOCC facility and network configuration is provided in this Implementation Plan [DCN/ICN, 96b]. A brief description of the MOCC network configuration is provided in the System Overview (paragraph 1.2). Local facilities are dictated by subscriber organization needs. Single subscribers do not need a local operations control center since Internet network access and technical support is handled by the subscriber's Internet Access Provider.
The subscriber will need computer and local communication facilities to connect to the Internet though an Enterprise connection or through a third party Internet Access Provider (IAP).
2.6.2 Management Operations Control Center Facility
Facilities for the MOCC will include office space (approximately 6500 square feet); office furniture [workstation furniture for 8 personnel in the first year (Phase I) and 16 personnel in the second year (Phase II)]; and telephone system (voice mail, call forwarding, call-waiting) for management, technical, and Hot Line Service Desks personnel. A preliminary design layout for the MOCC is shown in Figure 2.6.2-1.

Figure 2.6.2-1 Preliminary Facility Layout for the MOCC
Personnel requirements for the Local Operations Control Center are dictated by the local organization needs. During the first year 6-10 DoD Program Offices will be supported. During the second year 15-20 DoD/International Program Offices or virtual organizations shall be supported.
Personnel include local system administration, and, optionally, network security personnel at each node that depends on the size and complexity of the subscriber's information infrastructure. A rule of thumb is one system administrator per 25 end-users.
2.7.2 Management Operations Control Center Personnel
Estimated staffing requirements for the MOCC for the first two years of operation are highlighted in Table 2.7.2-1 "Manpower Staffing Plan (Year 1)" and "Table 2.7.2-2 Manpower Staffing Plan (Year 2)." Operations and technical transfer personnel will participate in the pilot program testing.
Table 2.7.2-1 Manpower Staffing Plan (Year 1)

Table 2.7.2-2 Manpower Staffing Plan (Year 2)

The equipment for the implementation and test of the DCN/ICN includes end-user terminals or workstations, Internet servers, and related Internet communications equipment, including automated facsimile servers and voice-mail systems. In addition, equipment for the MOCC is needed to provide DCN/ICN wide help desk and system administration services. The hardware and software are specified in the Preliminary DCN/ICN Pilot Program Test Software and Equipment Report [DCN/ICN 97c].
2.9 Test Schedule and Resources
A preliminary pilot program implementation and testing schedule is shown in Table 2.9-1.
Table 2.9-1 Preliminary Pilot Program Installation and Test Activity Schedule
Activity ID |
Activity Description |
Start |
Complete |
LOE |
POP |
Resource |
2000-00 |
Site/User Installation and Test |
11/01/96 |
07/28/97 |
296 |
269 |
|
2000-1 |
Develop Survey Instrument |
11/01/96 |
11/08/96 |
5 |
Team Leader | |
2000-2 |
Conduct DoD/PMO Site Surveys (Sites 1,2) |
11/08/96 |
11/22/96 |
10 |
Survey Team | |
2000-3 |
Tailor Bill of Materials (BOM) to Site Requests |
11/22/96 |
11/26/96 |
2 |
Survey Team | |
2000-4 |
Acquire Products |
11/26/96 |
12/24/96 |
20 |
Purchasing Office | |
2000-5 |
Construct Product INCO Kits |
12/24/96 |
01/21/97 |
20 |
Install Team | |
2000-6 |
Installation Site #1 |
01/21/97 |
01/28/97 |
5 |
Install Team | |
2000-61 |
Test Site #1 |
01/28/97 |
03/18/97 |
35 |
Test Team | |
2000-62 |
Site #1 Test Report |
03/18/97 |
03/25/97 |
5 |
Test Team | |
2000-7 |
Installation Site #2 |
03/18/97 |
03/25/97 |
5 |
Install Team | |
2000-71 |
Test Site #2 |
03/25/97 |
04/22/97 |
20 |
Test Team | |
2000-72 |
Site #2 Test Report |
04/22/97 |
04/29/97 |
5 |
Test Team | |
2000-8 |
Conduct DoD/PMO Site Surveys (Sites 3,4) |
03/25/97 |
04/08/97 |
10 |
Survey Team | |
2000-9 |
Tailor BOM to Site Reqs |
04/08/97 |
04/10/97 |
2 |
Survey Team | |
2000-10 |
Acquire Products |
04/10/97 |
04/17/97 |
5 |
Purchasing Office | |
2000-11 |
Construct Product INCO Kits |
04/17/97 |
04/24/97 |
5 |
Install Team | |
2000-12 |
Installation Site #3 |
04/24/97 |
05/01/97 |
5 |
Install Team | |
2000-121 |
Test Site #3 |
05/01/97 |
05/29/97 |
20 |
Test Team | |
2000-122 |
Site #3 Test Report |
05/29/97 |
06/05/97 |
5 |
Test Team | |
2000-13 |
Installation Site #4 |
05/01/97 |
05/08/97 |
5 |
Install Team | |
2000-131 |
Test Site #4 |
05/29/97 |
06/26/97 |
20 |
Test Team | |
2000-141 |
Site #4 Test Report |
06/05/97 |
06/12/97 |
5 |
Test Team | |
2000-14 |
Conduct DoD/PMO Site Surveys (Sites 5,6) |
05/08/97 |
05/22/97 |
10 |
Survey Team | |
2000-15 |
Tailor BOM to Site Reqs |
05/22/97 |
05/26/97 |
2 |
Survey Team | |
2000-16 |
Acquire Products |
05/26/97 |
06/02/97 |
5 |
Purchasing Office | |
2000-17 |
Construct Product INCO Kits |
06/02/97 |
06/16/97 |
10 |
Install Team | |
2000-18 |
Installation Site #5 |
06/16/97 |
06/23/97 |
5 |
Install Team | |
2000-181 |
Test Site #5 |
06/23/97 |
07/21/97 |
20 |
Test Team | |
2000-182 |
Site #5 Test Report |
07/21/97 |
07/28/97 |
5 |
Test Team | |
2000-19 |
Installation Site #6 |
06/23/97 |
06/30/97 |
5 |
Install Team | |
2000-191 |
Test Site #6 |
06/30/97 |
07/28/97 |
20 |
Test Team | |
2000-192 |
Site #6 Test Report |
07/28/97 |
08/04/97 |
5 |
Test Team |