環保專案成果報告查詢系統

專案計畫編號
經費年度	110
計畫經費	15,770 千元
預算科目	數位建設-建構開放政府及智慧城鄉服務
專案開始日期	2021/06/22
專案結束日期	2022/12/10
專案主持人	邱泊寰
主辦單位	監資處
承辦人	魏文娟
執行單位	卡米爾股份有限公司
專案分類	環境資訊系統
中文關鍵字	物聯網、感測資料收集、傳輸通訊協定、應用程式介面、資料交換、靜態直欄檔案結構
英文關鍵字	IoT, Sensor Data Collection, protocols, API, Data Exchange, Column-based parquet
協同主持人
共同主持人
計畫聯絡人	盧怡婷
計畫聯絡電話	03-5727778#
計畫聯絡信箱	ytlu@cameo.tw

中文摘要	(1) 感測資料搜集、流通與應用收容感測資料持續不間斷，精進資料流的監控與提供API及MQTT介接服務，以統一格式提供給應用端分析使用，減少應用端進行資料格式整理之複雜度，而能專注於資料呈現與分析。 (2) 架構調整與效能提升採用靜態直欄世界標準的Aparche Parquet檔案結構儲存物聯網即時大數據資料流，降低系統I/O負載，減少儲存空間並有效提升系統效能與服務水準。 (3) 下載中心加速及強化UI/UX 提供新版下載中心統一流程頁面，協助使用者分流獲取原始資料或加值自動化計算後平均結果；以靜態直欄檔案儲存及提供下載，減少撈取資料系統負擔，大幅提升使用者體驗。 (4) 感測設備資訊與數據品質管理優化完整率每日線上報表開發，有效彙整各縣市數據上傳完整率、數據異常狀況，能以權限控管方式將各縣市的專案提供各縣市來檢視，輔助縣市檢視上傳數據的完整率與健康程度，並提供視覺化儀表板之功能，協助設備端與分析端的參考依據。 (5) 環境物聯網資安配合事宜配合貴署每季產出的資安防護報告，並對資安議題進行修補，可以有效地找出系統的弱點並進行適當的修補，防止系統遭到有心人士的破壞，或是竊取系統中專屬的資料，且作為後續開發新功能時的借鏡。 (6) 環境感測資料中心維運與管理協助貴署進行東七機房以及本計畫所建置臺中文心機房第二資料服務中心布署之環境感測資料中心平臺維運，並配合上述私有雲系統進行資安控管、系統管理、帳號管理、資料收納操作處理及維持正常運作。
中文關鍵字	物聯網、感測資料收集、傳輸通訊協定、應用程式介面、資料交換、靜態直欄檔案結構

中文摘要

(1) 感測資料搜集、流通與應用收容感測資料持續不間斷，精進資料流的監控與提供API及MQTT介接服務，以統一格式提供給應用端分析使用，減少應用端進行資料格式整理之複雜度，而能專注於資料呈現與分析。 (2) 架構調整與效能提升採用靜態直欄世界標準的Aparche Parquet檔案結構儲存物聯網即時大數據資料流，降低系統I/O負載，減少儲存空間並有效提升系統效能與服務水準。 (3) 下載中心加速及強化UI/UX 提供新版下載中心統一流程頁面，協助使用者分流獲取原始資料或加值自動化計算後平均結果；以靜態直欄檔案儲存及提供下載，減少撈取資料系統負擔，大幅提升使用者體驗。 (4) 感測設備資訊與數據品質管理優化完整率每日線上報表開發，有效彙整各縣市數據上傳完整率、數據異常狀況，能以權限控管方式將各縣市的專案提供各縣市來檢視，輔助縣市檢視上傳數據的完整率與健康程度，並提供視覺化儀表板之功能，協助設備端與分析端的參考依據。 (5) 環境物聯網資安配合事宜配合貴署每季產出的資安防護報告，並對資安議題進行修補，可以有效地找出系統的弱點並進行適當的修補，防止系統遭到有心人士的破壞，或是竊取系統中專屬的資料，且作為後續開發新功能時的借鏡。 (6) 環境感測資料中心維運與管理協助貴署進行東七機房以及本計畫所建置臺中文心機房第二資料服務中心布署之環境感測資料中心平臺維運，並配合上述私有雲系統進行資安控管、系統管理、帳號管理、資料收納操作處理及維持正常運作。

中文關鍵字

物聯網、感測資料收集、傳輸通訊協定、應用程式介面、資料交換、靜態直欄檔案結構

類型	檔名	檔案大小	說明	最新版公開日期
期末報告	110-111年環境感測資料中心營運維護計畫_結案報告_V1.0公開版.pdf	94MB	110-111年環境感測資料中心營運維護計畫結案報告公開版	2023/2/20 上午 12:00:00

摘要	The major work in this project is comprised of the following parts： a. Sensing data collection, circulation and application The containment of sensing data is continuous and uninterrupted, the data flow monitoring has improved and API and MQTT interface services are provided, which are provided in a unified format for analysis and use on the application side, reducing the complexity of data format arrangement on the application side, and can focus on data presentation and analyze. b. Structural adjustment and performance improvement Using the world standard static column - Apache Parquet - file structure to store real-time big data streams of the Internet of Things, reducing system I/O load, reducing storage space and effectively improving system performance and service levels. c. Download center acceleration and enhanced UI/UX Provide a new version of the download center unified process page to assist users to obtain raw data or the average result after automatic value-added calculations; store and provide downloads in static column files, reducing the burden on the data retrieval system and greatly improving user experience. d. The optimization of sensor/device metadata and data quality management The development of online daily complete rate sheet effectively collects the data uploading complete rate and records data abnormality of each county/city, and can provide the review authority to each county/city in the way of authority control, assisting the counties/cities to check the complete rate of uploaded data and health level. Moreover, to provide the visualized dashboard as reference of the device side and the analysis side. e. Information security With the cooperation of quarterly information security protection reports and repairing information security issues, we can effectively find the weaknesses of the system and make appropriate repairs to prevent the hack attack, or steal exclusive data in the system, and serve as a reference for subsequent development of new functions. f. Maintenance and management of environmental sensing data center Assist EPA in the maintenance and operation of the environmental sensing data center platform deployed in the Dong-chi machine room and Taichung Wen-shin machine room built by this project, and cooperate with the private cloud system(a0-iot) mentioned above to carry out information security control, system management, user account management, data storage operation processing and maintenance of normal operation.
英文關鍵字	IoT, Sensor Data Collection, protocols, API, Data Exchange, Column-based parquet

摘要

The major work in this project is comprised of the following parts： a. Sensing data collection, circulation and application The containment of sensing data is continuous and uninterrupted, the data flow monitoring has improved and API and MQTT interface services are provided, which are provided in a unified format for analysis and use on the application side, reducing the complexity of data format arrangement on the application side, and can focus on data presentation and analyze. b. Structural adjustment and performance improvement Using the world standard static column - Apache Parquet - file structure to store real-time big data streams of the Internet of Things, reducing system I/O load, reducing storage space and effectively improving system performance and service levels. c. Download center acceleration and enhanced UI/UX Provide a new version of the download center unified process page to assist users to obtain raw data or the average result after automatic value-added calculations; store and provide downloads in static column files, reducing the burden on the data retrieval system and greatly improving user experience. d. The optimization of sensor/device metadata and data quality management The development of online daily complete rate sheet effectively collects the data uploading complete rate and records data abnormality of each county/city, and can provide the review authority to each county/city in the way of authority control, assisting the counties/cities to check the complete rate of uploaded data and health level. Moreover, to provide the visualized dashboard as reference of the device side and the analysis side. e. Information security With the cooperation of quarterly information security protection reports and repairing information security issues, we can effectively find the weaknesses of the system and make appropriate repairs to prevent the hack attack, or steal exclusive data in the system, and serve as a reference for subsequent development of new functions. f. Maintenance and management of environmental sensing data center Assist EPA in the maintenance and operation of the environmental sensing data center platform deployed in the Dong-chi machine room and Taichung Wen-shin machine room built by this project, and cooperate with the private cloud system(a0-iot) mentioned above to carry out information security control, system management, user account management, data storage operation processing and maintenance of normal operation.

英文關鍵字

IoT, Sensor Data Collection, protocols, API, Data Exchange, Column-based parquet