Machine Learning algorithms blogs surveyed

Motivation & Introduction:

Machine learning aim to develop computer programs that can access data and learn themselves. This automation without human interaction or intervention if mimicked similar to  the structures of brain then such programs or applications becomes an Artificial Intelligent systems. If they are as such used for constructive purpose to support technological advancements it is best way forward for human’s survival of fittest ^[1].

Methodology:

Questions like “Which algorithm to be used?”, “What are the types & techniques in Machine Learning algorithms?” forms the main hypothesis to be answered to through this survey^[2].

Literature:

The main ideas to think for a problem solver with machine learning algorithms were: What is the Business problem, Is my Objective requirements Operational/Strategic, How will a model be implemented & Algorithms capability that matches with requirements. The 3 ways of possibility to define the requirements are: Traditional statistical techniques on fundamentals, self-learning is ML & Neural networks are deep learning.

Survey on Real-world application and Research Directions from cybersecurity, smart cities, healthcare, e-commerce, agriculture etc.,^[3] is the actual motivation for anyone to start with selection and dissemination of such knowledge structures in the machine learning arena. This should start from fundamentally dealing with the hypothesis discussed here. How to Select the Right Machine Learning Algorithm ^[4] describes the 7 key factors to consider when you have to select the right machine learning algorithms. The basis again where to use which algorithm is dealt with in click ^[5].

Guide to choose the right machine learning algorithm ^[6]:

•     Size of the training data 
•     Accuracy and/or interpretability of the output
•        Speed or Training time
•        Linearity
•        No. of features

Figure courtesy: Choose-ml-technique at serokell.io^[7]

Essentials, Principles, Types & Examples ^[8]:

•       Data Vs Algorithm – terms to understand
•        Explainability vs Accuracy trade-offs
•        Principle is Y=f(X) in supervised learning
•        Types or Techniques:

o   Supervised

o   Un-Supervised

o   Semi-Supervised

o   Reinforcement 

·       Examples: Based on Space, time and Output

·       How to run ML Algorithms

     

Figure courtesy Hacker noon ^[9].

Commonly used ML algorithms in 2021^[10]:

·       Supervised

o   Linear regression

o   Logistic regression (a subset of Neural network)

o   Decision tree, CART

o   SVM algorithm

o   Naive Bayes algorithm

o   KNN algorithm 

·       Unsupervised:

o   K-means

o   Random forest algorithm

o   Dimensionality reduction algorithms, PCA

o   Association, Apriori, ANN ^[11] 

·       Ensembling:

o   Ensembling (Bagging, Bootstrap sampling) ^[12]

o   Gradient boosting algorithm and AdaBoosting algorithm

·       Reinforcement, Q-learning, Model-based value estimations,

o   GAN, Self-trained Naive Bayes ^[13]

Figure courtesy: Hui Li,  ML Cheat Sheet ^[15] 

·        Further tour:

ML Algorithms goes into more detailed single algorithms under each time^[14].  Good works suggests trends in similar lines for all portfolios of technology and the specific one on ML gives similar  overview as all above at ^[17]. Scikit-learn^[18] cheat sheet is quiet eye-opener. Compare two or more algorithms as suggested with step by step algorithms selection with python code at ^[16].Good works suggests trends in similar lines for all portfolios of technology and the specific one on ML gives similar overview as all above at ^[17].  Scikit-learn[18] cheat sheet is quiet an eye-opener. 

Figure Courtesy Scikit-learn[18] Hacker noon

Case : for Azure ML[20] 

The use case steps suggested for setup of a business requirement from Microsoft Azure found to be practical with the available resources and parameter tuning in own cloud setup

1.       Business scenarios and the Machine Learning Algorithm Cheat Sheet

2.       Comparison of machine learning algorithms

3.       Requirements for a data science scenario

4.       Accuracy

5.       Training time

6.       Linearity

7.       Number of parameters

8.       Number of features

Case for Smarter cities:

The Digital Twin Paradigm for Smarter Systems and Environments: The Industry use cases , many of the above and Canonical correlation Analysis for feature extraction type of task [20].

Case with Experiment implementation:

Commonly used Machine Learning Algorithms (with Python and R Codes) ^[22].

 As final remarks of a job interview questions and the like on how to choose consists of first classify the decision into data related and problem related ^[21].

 Conclusion:

 The survey put forward the ideas around machine learning by answering the hypotheses on which algorithms to be picked when and what does each one do. Though the writing itself is not detailed enough, it is a good collection for answering the fundamental questions such that the reader gets an overview in the field of Machine learning.

 References:

[1]    https://www.expert.ai/blog/machine-learning-definition/

[2]    https://www.analytixlabs.co.in/blog/how-to-choose-the-best-algorithm-for-your-applied-ai-ml-solution/

[3]    Sarker, I.H. Machine Learning: Algorithms, Real-World Applications and Research Directions. SN COMPUT. SCI. 2, 160 (2021). https://doi.org/10.1007/s42979-021-00592-x

[4]    https://towardsdatascience.com/how-to-select-the-right-machine-learning-algorithm-b907a3460e6f

[5]   https://www.datacamp.com/community/news/which-machine-learning-algorithm-should-i-use-raluply88ph

[6]   https://www.kdnuggets.com/2020/05/guide-choose-right-machine-learning-algorithm.html

[7]   https://serokell.io/blog/how-to-choose-ml-technique

[8]   https://www.knowledgehut.com/blog/data-science/machine-learning-algorithms

[9]   https://hackernoon.com/choosing-the-right-machine-learning-algorithm-68126944ce1f

[10]  https://www.simplilearn.com/10-algorithms-machine-learning-engineers-need-to-know-article

[11]   https://www.dezyre.com/article/common-machine-learning-algorithms-for-beginners/202/

[12]  https://www.dataquest.io/blog/top-10-machine-learning-algorithms-for-beginners/

[13] https://searchenterpriseai.techtarget.com/feature/5-types-of-machine-learning-algorithms-you-should-know

[14]  https://machinelearningmastery.com/a-tour-of-machine-learning-algorithms/

[15] https://blogs.sas.com/content/subconsciousmusings/2020/12/09/machine-learning-algorithm-use

[16]https://analyticsindiamag.com/how-to-choose-the-best-machine-learning-algorithm-for-a-particular-problem

[17]  https://www.goodworklabs.com/machine-learning-algorithm

[18] https://hackernoon.com/hn-images/1*9gGtNn2EXW1Zog-bjdGsHQ.png

[19] https://docs.microsoft.com/en-us/azure/machine-learning/how-to-select-algorithms

[20] https://www.sciencedirect.com/topics/engineering/machine-learning-algorithm

[21] https://www.youtube.com/watch?v=gZWhVj-g8Mc

[22] https://www.analyticsvidhya.com/blog/2017/09/common-machine-learning-algorithms