AIP-210 CertNexus Certified Artificial Intelligence Practitioner (CAIP) Questions and Answers

k-means clustering is an algorithm that should be used by the market research team to obtain groups of patients with similar unmet needs. k-means clustering is an unsupervised learning technique that partitions the data into k clusters based on the similarity of the features. The algorithm iteratively assigns each data point to the cluster with the nearest centroid and updates the centroid until convergence. k-means clustering can help identify patterns and segments in the data that may not be obvious or intuitive. References: [K-means clustering - Wikipedia], [How to Run K-Means Clustering in Python]

Personal data is any information that relates to an identified or identifiable individual, such as name, address, email, phone number, or biometric data. Personal data should not be disclosed, made available, or otherwise used for purposes other than specified, except with:

• The consent of the person it is collected from: Consent is a clear and voluntary indication of agreement by the person to the processing of their personal data for a specific purpose. Consent can be given by a statement or a clear affirmative action, such as ticking a box or clicking a button.
• The authority of law: The authority of law is a legal basis or obligation that requires or permits the processing of personal data for a legitimate purpose. For example, the authority of law could be a court order, a subpoena, a warrant, or a statute.

Completeness is a quality criterion that describes the degree to which all required measures are known. Completeness can help assess the coverage and availability of data for a given purpose or analysis. Completeness can be measured by comparing the actual number of measures with the expected number of measures, or by identifying and counting any missing, null, or unknown values in the data.

Random forest is an algorithm that is ideal to prevent overfitting when using a dataset with many features and a small sample size. Random forest is an ensemble learning method that combines multiple decision trees to create a more robust and accurate model. Random forest can prevent overfitting by introducing randomness and diversity into the model, such as by using bootstrap sampling (sampling with replacement) to create different subsets of data for each tree, or by using feature selection (choosing a random subset of features) to split each node in a tree.

Precision and recall are two measures that can evaluate the performance of a classifier, especially when the data is imbalanced. Precision is the ratio of true positives (correctly predicted positive cases) to all predicted positive cases. Recall is the ratio of true positives to all actual positive cases. Precision and recall can help assess how well the classifier can identify the positive cases (the disease) and avoid false negatives (missed diagnosis) or false positives (unnecessary treatment).

 Independence is an assumption of linear regression that states that the errors (residuals) of the model are independent of each other, meaning that they are not correlated or influenced by previous or subsequent errors. Independence can be violated when the data has serial correlation or autocorrelation, which means that the value of a variable at a given time depends on its previous or future values. This can happen when the data is collected over time (time series) or over space (spatial data). In this case, the data is collected over time from a group of subjects, which may introduce serial correlation among the errors.

Normalization is the transformation of features so that they are on a similar scale, usually between 0 and 1 or -1 and 1. This can help reduce the influence of outliers and improve the performance of some machine learning algorithms that are sensitive to the scale of the features, such as gradient descent, k-means, or k-nearest neighbors. References: [Feature scaling - Wikipedia], [Normalization vs Standardization — Quantitative analysis]

Scalability and explainability are two criteria that are essential for ML models to achieve before deployment. Scalability is the ability of an ML model to handle increasing amounts of data or requests without compromising its performance or quality. Scalability can help ensure that the model can meet the demand and expectations of users or customers, as well as adapt to changing conditions or environments. Explainability is the ability of an ML model to provide clear and intuitive explanations for its predictions or decisions. Explainability can help increase trust and confidence among users or stakeholders, as well as enable accountability and responsibility for the model’s actions and outcomes.

Data skews happen in the ML pipeline when the distribution or characteristics of the live input data differ from those of the offline data used for training and testing the model. This can lead to a degradation of the model performance and accuracy, as the model is not able to generalize well to new data. Data skews can be caused by various factors, such as changes in user behavior, data collection methods, data quality issues, or external events. References: What is training-serving skew in Machine Learning?, Data preprocessing for ML: options and recommendations

Weighted class is a technique to rebalance a dataset by assigning different weights to each class, according to their frequency in the dataset. The weights are inversely proportional to the class frequency, meaning that rare classes have higher weights and common classes have lower weights. This helps to reduce the bias towards the majority class and improve the model performance on the minority class. References: 4. Data Validation - Building Machine Learning Pipelines, A guide to React design patterns - LogRocket Blog

Sampling bias occurs when a data segment is collected in such a way that some members of the intended statistical population are less likely to be included than others. This can result in a sample that is not representative of the population and may lead to inaccurate or misleading conclusions. Sampling bias can be caused by various factors, such as non-random sampling methods, non-response, self-selection, or convenience sampling. References: [Sampling bias - Wikipedia], [What is Sampling Bias? Definition, Types and Examples]

 Retraining is the process of updating an existing ML model with new or updated data to maintain or improve its performance and relevance. Retraining can help address various issues or challenges in ML systems, such as data drift, concept drift, model degradation, or changing requirements. Retraining can be done using different strategies, such as periodically, continuously, or on-demand.

For an AI system that recommends New Year’s resolutions, retraining periodically every year would be the best strategy for this pipeline. This is because New Year’s resolutions are seasonal and time-sensitive, meaning that they may vary depending on the year or the current situation. Retraining periodically every year can help ensure that the system’s recommendations are up-to-date and relevant for each new year.

When concept drift is detected in the pipeline, it means that the model performance has degraded over time due to changes in the underlying data generating process. This requires retraining the model with new data that reflects the current situation and updating the model parameters accordingly. References: Use pipeline parameters to retrain models in the designer - Azure Machine Learning | Microsoft Learn, Retraining Model During Deployment: Continuous Training and Continuous Testing

Distributed artificial intelligence (DAI) is a subfield of artificial intelligence that studies how multiple intelligent agents can coordinate and cooperate to achieve a common goal or solve a complex problem. DAI relies on a distributed system that performs robust computations across a network of unreliable nodes, such as sensors, robots, or humans. DAI can handle large-scale, dynamic, and uncertain environments that are beyond the capabilities of a single agent. References: [Distributed artificial intelligence - Wikipedia], [Distributed Artificial Intelligence: An Overview]

Latency is the time delay between a request and a response. Latency can affect the performance and user experience of an application, especially when real-time or near-real-time responses are required. Deploying a deep learning model as an embedded model on edge devices can reduce latency, as the model can run locally on the device without relying on network connectivity or cloud servers. Edge devices are devices that are located at the edge of a network, such as smartphones, tablets, laptops, sensors, cameras, or drones.

An L1 norm is a measure of distance or magnitude that is defined as the sum of the absolute values of the components of a vector. For example, if x and y are two components of a vector, then the L1 norm of that vector is |x| + |y|. The L1 norm is also known as the Manhattan distance or the taxicab distance, as it represents the shortest path between two points in a grid-like city.

Ridge regression is a type of linear regression that adds a regularization term to the loss function to reduce overfitting and improve generalization. Ridge regression is fast and requires low memory and low processing power, as it only involves solving a system of linear equations. Ridge regression can also handle multicollinearity (high correlation among predictors) by shrinking the coefficients of correlated predictors.

Security measures can be applied in different ML workflow stages to defend them against malicious activities, such as data theft, model tampering, or adversarial attacks. Some of the security measures are:

• Launch ML Instances In a virtual private cloud (VPC): A VPC is a logically isolated section of a cloud provider’s network that allows users to launch and control their own resources. By launching ML instances in a VPC, users can enhance the security and privacy of their data and models, as well as restrict the access and traffic to and from the instances.
• Use data encryption: Data encryption is the process of transforming data into an unreadable format using a secret key or algorithm. Data encryption can protect the confidentiality, integrity, and availability of data at rest (stored in databases or files) or in transit (transferred over networks). Data encryption can prevent unauthorized access, modification, or leakage of sensitive data.
• Use Secrets Manager to protect credentials: Secrets Manager is a service that helps users securely store, manage, and retrieve secrets, such as passwords, API keys, tokens, or certificates. Secrets Manager can help users protect their credentials from unauthorized access or exposure, as well as rotate them automatically to comply with security policies.

 Transparency is an ethical principle that describes the degree to which an AI system can provide clear and understandable information about its inputs, outputs, processes, and decisions. Transparency can help increase trust and confidence among users and stakeholders, as well as enable accountability and responsibility for the system’s actions and outcomes. Logging and storing historical predictions for potential, future access requests is an example of transparency, as it can help provide evidence and explanation for the system’s recommendations, as well as facilitate auditing and feedback.

Adversarial attacks are malicious attempts to fool or manipulate machine learning models by adding small perturbations to the input data that are imperceptible to humans but can cause significant changes in the model output. In general, models that perform their tasks more accurately are less robust against adversarial attacks, because they tend to have higher confidence in their predictions and are more sensitive to small changes in the input data. References: [Adversarial machine learning - Wikipedia], [Why Are Machine Learning Models Susceptible to Adversarial Attacks? | by Anirudh Jain | Towards Data Science]

Word embedding is a task in natural language processing (NLP) where words are converted into numerical vectors that represent their meaning, usage, or context. Word embedding can help reduce the dimensionality and sparsity of text data, as well as enable various operations and comparisons among words based on their vector representations. Some of the common methods for word embedding are:

• One-hot encoding: One-hot encoding is a method that assigns a unique binary vector to each word in a vocabulary. The vector has only one element with a value of 1 (the hot bit) and the rest with a value of 0. One-hot encoding can create distinct and orthogonal vectors for each word, but it does not capture any semantic or syntactic information about words.
• Word2vec: Word2vec is a method that learns a dense and continuous vector representation for each word based on its context in a large corpus of text. Word2vec can capture the semantic and syntactic similarity and relationships among words, such as synonyms, antonyms, analogies, or associations.
• GloVe: GloVe (Global Vectors for Word Representation) is a method that combines the advantages of count-based methods (such as TF-IDF) and predictive methods (such as Word2vec) to create word vectors. GloVe can leverage both global and local information from a large corpus of text to capture the co-occurrence patterns and probabilities of words.

R-squared is a statistical measure that indicates how well a regression model fits the data. R-squared is calculated by dividing the explained variance by the total variance. The explained variance is the amount of variation in the dependent variable that can be attributed to the independent variables. The total variance is the amount of variation in the dependent variable that can be observed in the data. R-squared ranges from 0 to 1, where 0 means no fit and 1 means perfect fit.

Model validation is the process of checking whether the model meets the specified requirements and quality standards. It involves testing the model on a validation dataset, which is different from the training and testing datasets, and evaluating the model performance using appropriate metrics. References: Overview of ML Pipelines | Machine Learning, MLOps: Continuous delivery and automation pipelines in machine learning

Data lineage is the process of tracking the origin, transformation, and usage of data throughout its lifecycle. It helps to ensure data quality, integrity, and provenance. Data lineage also supports the Privacy by Design methodology, which is a framework that aims to embed privacy principles into the design and operation of systems, processes, and products that involve personal data. By understanding, documenting, and displaying data lineage, an ML system can demonstrate how it collects, processes, stores, and deletes personal data in a transparent and accountable manner3 .