Science topic

Data Engineering - Science topic

Explore the latest questions and answers in Data Engineering, and find Data Engineering experts.
Questions related to Data Engineering
  • asked a question related to Data Engineering
Question
8 answers
One of my master students is currently conducting a preliminary study to find out the maturity of the Cross Industry Standard Process for Big Data (CRISP4BigData) for use in Big Data projects. I would like to invite all scientists, Big Data experts, project managers, data engineers, data scientists from my network to participate in the following survey. Feel free to share!
Relevant answer
Answer
Done
  • asked a question related to Data Engineering
Question
8 answers
hey guys, I'm working on a new project where I should transfer Facebook ads campaigns data to visualize in tableau or Microsoft power BI, and this job should be done automatically daily, weekly or monthly, I'm planning to use python to build a data pipeline for this, do you have any suggestions or any Resources I can read or any projects similar I can get inspired from ? thank you .
Relevant answer
Answer
To create an ETL pipeline using batch processing, you must first:
1. Construct reference data: create a dataset that outlines the range of possible values for your data.
2. Extract data from various sources: Correct data extraction is the foundation for the success of future ETL processes.
  • asked a question related to Data Engineering
Question
4 answers
dear community, I need some sources for some data science project or machine learning project related to analyzing the google analytics and Facebook business data , your help is appreciated.
  • asked a question related to Data Engineering
Question
7 answers
Hi,
While learning about different algorithms such as Regression, Clustering, Classification, etc. in Machine Learning in different domains such as Medicine (Patient data analysis, etc.), Market analysis, etc. I wonder, how these algorithms could be implemented in Power Electronics or Grid Applications? Any ideas?? Are there any datasets available similar to the ones in UCI ML repositories??
Thanks in advance.
Relevant answer
Answer
In my opinion the AI can be applied in different sector , Computer Versions (Robotic), Automotive sector(Autonomous vehicle's), economics (financial)....etc.
For Grid Applications that you can do it the smart Network for gesture the power Electric or surveying the Sun for the most energy for stocks in batteries to do it With Deep Leraning.
I hope that be Clair. @Ravi Verma
  • asked a question related to Data Engineering
Question
9 answers
I need it for market research. Also there is a question what kind of researchers and in which industries they use the visual/audible (image, video, audio). I need to estimate the size of researchers that will use visual/audible datasets. I need your help. Thanks in advance!
Relevant answer
Answer
Dear Mammadzada,
I do. I think a huge number of researchers use visual datasets since deep learning (in particular, convolutional neural network applied to image understanding) is a hot topic in artificial intelligence. In addition, an easy way to obtain these data is to look for visual papers in google scholar, I think you can obtain a faster feedback.
  • asked a question related to Data Engineering
Question
4 answers
I am trying to use weka on our cluster, running sun grid engine. I installed Weka myself without root permission, and added CLASSPATH info to .rcsh. When I run a shell command invoking WEKA (with csh, which is our default SGE shell), it works fine. But when I submit the same job to the queue, I get "large word" error.
If anyone has used weka with SGE, I would appreciate some advice.
Relevant answer
Answer
I will try to re-submit my job to grid and see what i did to make it work tonight, sorry i dont have access at the moment.