|
Data Access Object (DAO) Data Structure
Our First Parser-Converter Seed With Java Code Introduction: Our Intelligent CRM Metadata (ICM) project is a part of our bigger project "Post Office" (PO) PO is an end-to-end solution to CRM, Big Data, BI, Analytics, Security, Data Centers plus a number of other topics. PO is a new way of handling what is done by the big vendors such as Google, Amazon, the three credit bureaus and big data vendors. Our Approach is to revolutionize data from being dummy stagnant storage to an Intelligent Data Services which automates, parses, thinks in abstract, makes decisions and gives options. Our Intelligent Data Access Object (IDAO) is memory resident data object which is an intelligent interface between our XML Database files and any running application. ICM Big Data Conversion: Big Data Conversion is not a simple task ; its size and complexity are growing exponentially. Our ICM project's goal is converting Big Data into XML-DAO (using Java and SOAP) which is processed faster and stored easier. This page presents our approach which simplifies Big Data Conversion. Objectives: Our approach to Big Data and all its issues, is to replace databases tables with XML files. Any existing Big Data (structured, unstructured and Legacy System) must be converted to our XML files structure. To make our goal attainable, we built a "Seed Framework" with working prototypes for development teams to use as a start of their target development (see our First Seed Java Packages and A Running Prototype Section). Testing the target development can be done using our "Turn Key" DevOps Editor. 
Image #1 Looking at Intelligent CRM Metadata (ICM) Seed Framework diagram (Image #1), our architect-design's objectives are:
Our First Seed Java Packages and A Running Prototype Our First ICM Seed Framework: We have built our "ICM_DB_TestComponents" project using NetBeans. We had chosen excel sheets as the project first input data for a number of reasons. First, most companies have thousands if not hundreds of thousands of excel sheets with critical data which is a big part of the Big Data dilemma. Excel sheets have no fixed standards in their creation or format, therefore they bring to our parser and converts the biggest challenges. Having copies of excel sheets to test our parsers and converter do not require any special effort as in the case of databases. Also excel formulas can be used in making our DAO an Intelligent DAO (IDAO). see the LINK IDAO Architect Page for adding Intelligence to DAO. The following are the actual code of our for "ICM_DB_TestComponents" project. We created our first Parser-Converter Java code and we called "Using Business Rule #1". The following are our "ICM_DB_TestComponents" project input-out files and Java code files. We welcome any feedback or comments and our contact email is: Sam@SamEldin.com Input Files: 1. SimpleInputExcelSheet.xlsx 2. BusinessToken_ID.txt Java Constant Classes: 1. MainConstants.java 2. SOAP_XML_Constants.java 3. ExcelDAO_Constants.java Package: Java DAO Classes - unstructured_data_idao: 1. ExcelCellMap2DAO.java 2. ExcelColumnMap2DAO.java 3. JavaCodeGeneratorDAO.java 4. OneRow_ExcelCells.java 5. TokenValueDAO.java Package - unstructured_data_parser: 1. ColumnCellParserUsingBusinessRule_1.java 2. Convert2DAO_Class_UsingBusinessRule_1.java 3. DAO2SOAP_XML_Converter.java 4. DAO_ClassLoader.java 5. DAO_DynamicCompilation.java 6. Excel2DAO_CellParserBusinessRule_1.java 7. Excel2DAO_Mapper.java 8. LoadTokenValueArrayList.java 9. ParsingSOAP_XML_MessagesFile.java 10. RowCellParserUsingBusinessRule_1.java Output Files: 1. SimpleInputExcelSheetDAO.java 2. SimpleInputExcelSheet_XML.xml 2. Debugger Tracking of Input and Output javadoc: 1. ICM_DB_TestComponents javadoc link Architect-Design in a Nutshell Our goal of "ICM_DB_TestComponents" project to automate the parsing-converting any excel sheet to DAO and SOAP-XML file. It has to perform the following:
|
|---|
