EPA-97-L103-03-003

097

15,750 千元

2008/03/11

2008/12/31

林永青

監資處

葉麗雲

中興工程顧問工程社

環境資訊系統

環境品質資料倉儲系統建置計畫

environmental data warehouse system

林永青

02-27692131#20984

winglin@sinotech.org.tw

行政院環境保護署為使資料能作充分整合，提升以主題、地區、時間作查詢分析之效率，辦理本計畫規劃建置「環境品質資料倉儲」，並作為日後推動「全國環境資料中心」(Taiwan Environmental Data Center, TENDC)的基石。 本計畫主要工作為規劃、設計、開發建置環境品質資料倉儲系統，購置相關軟硬體設備及研訂資料倉儲維運作業規範及機制。資料倉儲之建置過程，以系統需求分析、業務單位訪談、資料蒐集及資料分析開始著手，接著進行主題分類討論、召開專家諮詢會議、規劃倉儲架構、設計系統功能、建置軟硬體、資料轉檔等工作，將來源資料萃取、轉換、匯入資料倉儲中，最後完成查詢網站開發。 環境品質資料倉儲系統已完成環保署各業務單位30個資料庫整合，資料倉儲分為8大主題，包括：空氣(Air quality)、水(Water)、廢棄物與資源回收(Waste)、毒化物與環境用藥(Toxics)、土壤(Soil)、噪音與非游離輻射(Noise & Radiation)、環境管理(Environmental Management)及其他等，來源資料包括環境監測(Environmental Monitoring)、環境統計(Statistics)、環保基金(Fund)、列管場所(Control and monitoring premises)、稽查處分(investigation and disciplinary)、空水廢毒整合基線資料(Environmental Management System)(EMS)等重要資料。前述各項資料匯入資料倉儲後，遵循資料倉儲特有之資料結構，以主題導向、整合方式區分為事實表(Fact table)及維度表(Dimension table)(時間、空間、測項等)儲存實體資料，以達致主題導向性、整合性、具分析性及多維度報表查詢功能，97年度倉儲已彙整資料約計2,765萬筆。 為確保資料倉儲之資料可隨時更新，本計畫訂定資料交換、資料載入、資料轉換及匯入排程等資料更新機制等。同時，提供主題式資料展示功能，整合本署水質監測資料、水利署(Water Resources Agency)之河川水量資料、列管污染整合性資料，同時結合Google map呈現跨機關之綜合性資料。 本計畫亦利用線上分析工具(OLAP)，完成以地區、時間、主題等條件，進行一站式、跨業務系統、跨機關之多維度資料查詢功能，以充分達到環境資料整合及運用之效益。未來，可再運用資料倉儲特有之儲存架構，將更輕易地與地理資訊系統(GIS)結合，發展更多OLAP線上分析及資料採礦之應用。

環境品質資料倉儲系統建置計畫

EDW2008期末報告(公開版).rar

1MB

2009/3/1 上午 12:00:00

In order to integrate the data sufficiently, promote the efficiency of analysis and inquiry by theme, area, and time, the Environmental Protection Administration (EPA) of Executive Yuan handles this Project to establish the Environmental Data Warehouse, so as to use it as the basis to promote the “Taiwan Environmental Data Center” (TENDC) in the future. The major work of this Project is to plan, design, develop, and establish the Environmental Data Warehouse system, purchase the relevant software and hardware, and regulate the operation standard and mechanism of data warehouse. The establishment process of data warehouse is to analyze the system requirement, interview the business unit, collect and analyze the data first, then discuss the category of theme, hold the consulting meeting of experts, plan the structure of warehouse, design the function of system, set up the software and hardware, complete the transformation of data files, extract, transfer, import the source data into data warehouse, and finish the development of inquire website finally. The Environmental Data Warehouse system has already finished 30 databases from the business units of Environmental Protection Administration. The data warehouse is divided into 8 themes, including the air quality, water, waste and resource recovery, toxic substances and environmental pesticides, soil, noise and radiation, and environmental management and others. The source data include the important data from the environmental monitoring, environmental statistics, environmental protection fund, control and monitoring premises, investigation and disciplinary, and the Environmental Management System (EMS). After the above-mentioned data are inputted into the data warehouse, the specific data structure of data warehouse is followed to store the physical data by the integration of theme orientation, fact table and dimension table (time, space, test item etc.), in order to reach the theme orientation, integration, analysis and multiple dimensional report inquiry function. About 27,650,000 data has already been gathered into the data warehouse in 2008. In order to assure the update of data in the data warehouse at any time, this Project stipulates the data update mechanism for data exchange, data loading, data transformation and import scheduling etc. Meantime, it provides the theme-type data display function, integrates the water quality monitoring data of the EPA and the river water amount data of the Water Resources Agency, controls and monitors the integrated data of pollution, and combines the comprehensive data of Google map and relevant authorities. This Project also employs the On-Line Analytical Processing (OLAP) to finish a single-station type, inter-business and inter-authority system with multiple dimensional data inquiry function by the condition of area, time, and theme etc., in order to reach the efficacy of environmental data integration and application fully. In the future, it can adopt the specific storage structure of data warehouse again to combine the Geographical Information System (GIS) more easily, in order to develop more applications on OLAP analysis and data mining.

environmental data warehouse system