IFINDIT Analytics

What is IFINDIT®?

It is an increasing collection of services arranged in a private cloud that using Big Data technologies allows you to read, clean transform, enrich, cross, operate, find, visualize, publish, deliver data of different types to generate value.

It comprises a set of integrated tools, pre-designed templates and managed services that make it easier to create and manage information.

It also includes core products such as advanced data analytics and intelligent search.

It uses technologies such as Machine learning, Natural Language Processing, Spark, foundational models (Generative Artificial Intelligence), columnar databases among others.

Given its maturity level, it allows for agile, efficient, cost-effective solutions to improve access to information, knowledge generation, informed decision-making, among other challenges

IFINDIT® is a platform based on a private native cloud architecture, optimized for real-time applications that combines agile elastic storage capacity, with deep search capabilities, unparalleled relevance and AI capabilities. This architecture allows Creangel to offer its solutions under the SAAS modality, without requiring servers on the client side, this eliminates all operating expenses related to technological infrastructure so that you can start working quickly and scale your needs with a platform based on Big Data

In general terms IFINDIT, as an advanced search-based analytics platform, in addition to being oriented to Big data (allows millions of records per hour) allows carrying out, among others, the following processes:

Load: Includes the connectors deployed and ready to use the entity must provide the data to process through a generalized view (fact table) to which IFINDIT will connect via VPN site to site using any of these mechanisms:

• Connection to various types of database systems such as: SQL, MySQL, Oracle, DB2, Postgres, Informix, Cassandra, MariaDB, MongoDB, and other databases via JDBC.
• Data structured in files txt, Raw, xls, csv, parquet files.

Processing architecture: IFINDIT is based on Kappa architecture because it is necessary to have a data processing architecture designed to provide a scalable, fault-tolerant and flexible system for processing large amounts of data in both real time and batch.

Kappa uses a single data processing system to handle processing workloads in both flows and batches; this allows more agile and simple data processing while providing fast and reliable access to query results.

Columnar storage: This means that only loads the columns needed for a specific query, this allows to improve the speed of queries that recover only a few columns and additions (e.g. how many people with what features, in what period of time, etc.).

Scalable distributed system: The platform allows to grow elastically, given the high demand for information requested, it is necessary to contemplate operations that may include data loading at a speed of millions of records per minute and at the same time attend queries that generate results in a few seconds.

Massively parallel processing: The platform receives requirements that can include hundreds of millions of data in a single query, so it is necessary for the platform to be able to process each query in parallel throughout the cluster.

Reports: Allows to generate reports, aggregated data, columns, counts, SQL-type queries

Creating Wizard-type queries or reports: Allows people who do not have a high technical level to create reports in such a way that it is possible to split the workload to meet requirements quickly.

Data output:

The platform will provide data in some of the following presentations:

• Unadded data: xls, csv, txt, Json, XML
• Mass data: allows extracting data in packages of millions of records from dozens of columns each
• Visualization: The platform is capable of displaying data with visual features such as control dashboards, both for aggregated and non-aggregated data and capable of being displayed on both desktop and mobile devices

Security: The platform provides role-based authentication and access control mechanisms. It integrates with the Active Directory, but also allows the creation of local users to the platform.

Robustness: IFINDIT is capable of being used by thousands of users simultaneously, responding to requirements without impacting the information systems where the data are contained, these impacts are evident in particular in Databases, where memory consumption is very high in case of attendance.

BASE PROCESS

IFINDIT® handles data through three basic processes: data extraction, data transformation, data lake loading and data visualization. These processes ensure timely and sufficient information for decision-making in various functional areas of the organization.

I DATA EXTRACTION PROCESS

IFINDIT® Analytics specializes in data analytics at Big Data level, allowing large volumes of data to be processed with quick responses. It offers a comprehensive solution that includes the infrastructure needed to perform complex calculations in terms of millions of records. With more than 160 connectors, it allows to extract data from various sources, such as commercial databases (JDBC), flat files (csv, tsv), json files, xml and Excel spreadsheets, is a valuable source for data analytics in the different operating areas of the organizations. IFINDIT® Analytics eliminates customer concern for infrastructure and resource management, providing immediate responses to analytical requirements.

II DATA TRANSFORMATION PROCESS

The process of data transformation is crucial to turning information into elements of judgement that can be used to make sound decisions. In IFINDIT Analytics, the transformation takes place using Big Data techniques, allowing large volumes of data to be cleaned in a matter of hours, not days or weeks.

IFINDIT Analytics focuses on data cleaning at this stage, ensuring that they meet the required features and quality required for the specific intended use. With the features of Big Data, the platform allows large amounts of data to be consumed at extraordinary speeds, facilitating immediate calculations for business units.

Data analysts have access to gigabytes of information, allowing them to obtain indicators, apply filters and build control dashboards interactively. End users can build their own control dashboards intuitively, without the need for programming knowledge, using functions such as “dragging” and “dropping”. This streamlines the process without relying on the intervention of the IT area to meet its requirements.

The data is worked according to consumption needs, either in real time (streaming) for calculations that require constant update or batch (batch) for results that can be consumed at specific times. In an hour, 180 million records of 90 fields each can be cleaned, demonstrating the efficiency and speed of the process.

III Charging process in the data lake

After data transformation, these are directed to a lake with the capacity to manage Big Data volumes, allowing different treatments according to the needs of the organization or functional areas. Structured data are used for calculations using a library with approximately 50 interactive dashboards.

IFINDIT Analytics facilitates analytical exercises by having both structured data and data extracted from unstructured sources in a columnar database called IFINDIT Columnar. Designed to optimize analysis of large volumes of information, it offers answers in seconds. The tool responds immediately to file search requests, providing access or enabling analytic calculations to be performed at Big Data speed.

The analytics is carried out using Interactive Control Dashboards, which allow you to build efficient visualizations without the need for programming, through intuitive methods such as “drag and drop”. Users who prefer different display tools can connect to the data lake using an API to take advantage of the benefits of IFINDIT Column.

IV. SECURITY MODULE

The security module in the IFINDIT® solution is essential to ensure controlled access to data. Integrated with the Active Directory, it establishes security levels based on user roles and company policies. Access privileges inherit the policies of the integrated web information system, ensuring security from source.

The security architecture of the tool is designed to mitigate common attacks, such as code injection and denials of service. The communication between the server and clients can be configured to use only secure protocols (SSL), ensuring data protection during transmission, both in text searches and in the presentation of interactive reports. This safe approach allows for internal and external deployments, providing full data protection.

Technical conditions for the use of software

Since IFINDIT® is a platform based on a private native cloud architecture, you will NOT require client-side servers to benefit from the computing power offered, so to start the platform you are given access to IFINDIT® by:

(i) a user and password to the administration portal or

(ii) A connection through a VPN site to site to the sources to integrate

(iii) A connection through a VPN

IFINDIT Requires access with read-only privileges to information sources.

Part Numbers

On small screens, scroll the table horizontally to consult all columns.

CONSULT US TO CREATE A SEARCH SOLUTION TO THEIR MEASURE