¿Cómo entrena y actualiza su modelo de clasificación de imágenes con nuevos datos?

In my domain of histopathology, I focus not on angles and shadows, but on tissue staining/coloring. Acquiring architecturally salient structures in small FOVs that also capture variety of cell types. This also achieves a sort of microdissection overlay over macro dissection. Later segmentation is then more useful and gives better results when tested.

My work is working with videos requires a careful approach when selecting a data source for machine learning. Relevance, diversity, and a substantial volume of accurately labeled video frames are vital for real-world applicability and effective training, especially for deep-learning models. Ethical considerations, such as privacy, must be prioritized, and comprehensive documentation of sources and methods is essential. Additionally, anticipating scalability and embracing the iterative nature of data collection are key strategies for developing a robust and adaptable machine-learning model in the realm of video analysis.

I agree with the suggestion from Brian Cone about testing on real world data since vision models are really good at learning about the distribution of the input data (images) and using test data from the same distribution may not be as representative about the model's performance as compared to using test data from the real world, which may be slightly out of distribution.

Agree with the terms and hope we all use them similarly. Only thing I do differently is, given the how readily available histopathology “datasets” are, I do 80/20/0 80% train 20% validation 0% saved for testing. -Rather, I then extract new/unseen whole slide images from numerous open source and academic pathology archives. Test on the real world.

In my experience splitting the data into training and validation sets is a standard practice in machine learning. The training set is utilized to train your model, while the validation set is instrumental in tuning model parameters and evaluating its performance. With unique approach involves employing real-world data exclusively for testing, providing a robust assessment of how model's accuracy on unseen scenarios. While the common split ratio is 80% for training and 20% for validation, these percentages can be adjusted based on your specific data size and distribution, ensuring a tailored and effective model development process.

Choosing the right model architecture and framework is vital in the process. For image classification, options like ResNet18 and ResNet34 offer distinct approaches. Consideration of data characteristics, computational resources, and desired accuracy is crucial. Frameworks like TensorFlow, PyTorch, or Keras, aligned with your needs, provide tools for effective model development. The choice depends on aligning project requirements with the capabilities of the selected architecture and framework.

During the training and evaluation phase, essential parameters such as learning rate, epochs, batch size, dropout, early stopping, and loss function must be configured meticulously. Continuous monitoring of the model's performance on the validation set using metrics like accuracy, precision, recall, or F1-score is crucial for effective evaluation. Employing techniques such as data augmentation, regularization, and early stopping can play a significant role in enhancing the model's effectiveness and overall performance.

You can use the models pre-trained on some large datasets in two different ways including: 1- feature extraction and feeding the extracted features to conventional classifiers such as SVM and Random Forest 2- freezing the layer excluding some few last layers of the pre-trained model and change the output layer architecture and activation function according to the target task and choosing the appropriate loss function, then feeding new data to the model and training the model. In this approach, the weights of the frozen layers will not be updated. These two approaches are called transfer learning and is very common and popular while we want to use a pre-trained model for a new dataset and maybe a different target task.

Updating your model with evolving data. Strategies like retraining, fine-tuning (adjusting parameters such as L1, L2 regularization or even using no regularization), and incremental learning are key. Retraining starts fresh, fine-tuning refines parameters, and incremental learning integrates new data without losing prior information. These strategies ensure your model stays accurate and adaptable, reflecting the changing dynamics of your data.