{"id":70357,"date":"2023-12-13T07:49:23","date_gmt":"2023-12-13T10:49:23","guid":{"rendered":"https:\/\/abes.org.br\/?p=70357"},"modified":"2023-12-05T16:57:19","modified_gmt":"2023-12-05T19:57:19","slug":"nec-lanca-software-gratuito-fireducks-para-acelerar-a-analise-de-dados-no-python","status":"publish","type":"post","link":"https:\/\/abes.org.br\/en\/nec-lanca-software-gratuito-fireducks-para-acelerar-a-analise-de-dados-no-python\/","title":{"rendered":"NEC Releases Free FireDucks Software to Speed Up Data Analysis in Python"},"content":{"rendered":"

Tool allows data preparation up to 16 times faster, reducing time and cost needed to carry out the task<\/i><\/p>\n

\"\"<\/p>\n

NEC Corporation recently launched a new data analytics library called FireDucks (*1). The main feature of this new bookstore is its processing speed when compared, for example, to the most used bookstore in the world, \u201cpandas\u201d. Capable of performing the data preparation necessary for data analysis up to 16 times faster than existing libraries\/software (*2), this tool significantly reduces the time spent on the data analysis process and reduces computational costs. The beta version of FireDucks is now available for free online (https:\/\/fireducks-dev.github.io\/<\/a>).<\/p>\n

In recent years, it has become easier than ever to collect large volumes of data, including sales information obtained through card payment terminals (POS), e-commerce, e-commerce and financial transaction data. To extract valuable analytical results from this data, there is a growing need for data scientists to perform their analysis using artificial intelligence (AI) and machine learning (ML).<\/p>\n

However, to prepare for data analysis, large data sets need to be preprocessed. It is estimated that data scientists spend approximately 45% (*3) of their time preparing data, and this has become a huge problem. Furthermore, the increase in data volume and the evolution of AI and ML have led to an increase in computational complexity. As a result, higher computing costs (e.g. cloud costs) and the consequent increase in energy consumption and CO2 emissions have also become problematic.<\/p>\n

Given this, NEC set out to develop FireDucks, a\u00a0software<\/em>\u00a0designed to speed up the data manipulation process, and fully compatible with the \u201cpandas\u201d library, not requiring the\u00a0refactoring<\/em>\u00a0of the code. To develop this\u00a0software<\/em>\u00a0NEC leveraged the high-performance programming technology and acceleration expertise it cultivated from more than thirty years of experience developing supercomputers.<\/p>\n

By making the beta version of FireDucks available free of charge to the general public, NEC hopes to help reduce data analysis scientists' work hours in solving environmental issues through energy conservation and reducing CO2 emissions.<\/p>\n

Resources<\/strong><\/p>\n