Next Article in Journal
ClO2 Prolongs the Vase Life of Paeonia lactiflora ‘Hushui Dangxia’ Cut Flowers by Inhibiting Bacterial Growth at the Stem Base
Previous Article in Journal
Does the Daily Light Integral Influence the Sowing Density of Tomato Plug Seedlings in a Controlled Environment?
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions

1
Food Quality Laboratory, Henry A. Wallace Beltsville Agricultural Research Center, Agricultural Research Service, U. S. Department of Agriculture, Beltsville, MD 20705, USA
2
Environmental Microbial and Food Safety Laboratory, Henry A. Wallace Beltsville Agricultural Research Center, Agricultural Research Service, U. S. Department of Agriculture, Beltsville, MD 20705, USA
3
Department of Nutrition and Food Science, University of Maryland, College Park, MD 20742, USA
4
Sam Farr United States Crop Improvement and Protection Research Center, Agricultural Research Service, U. S. Department of Agriculture, Salinas, CA 93905, USA
*
Author to whom correspondence should be addressed.
Horticulturae 2024, 10(7), 731; https://doi.org/10.3390/horticulturae10070731
Submission received: 8 June 2024 / Revised: 1 July 2024 / Accepted: 2 July 2024 / Published: 12 July 2024
(This article belongs to the Section Postharvest Biology, Quality, Safety, and Technology)

Abstract

:
The popularity of ready-to-eat (RTE) salads has prompted novel technology to prolong the shelf life of their ingredients. Fresh-cut romaine lettuce is widely used in RTE salads; however, its tendency to quickly discolor continues to be a challenge for the industry. Selecting the ideal lettuce accessions for use in RTE salads is essential to ensure maximum shelf life, and it is critical to have a practical way to assess and compare the quality of multiple lettuce accessions that are being considered for use in fresh-cut applications. Thus, in this work we aimed to determine whether a computer vision system (CVS) composed of image acquisition, processing, and analysis could be effective to detect visual quality differences among 16 accessions of fresh-cut romaine lettuce during postharvest storage. The CVS involved a post-capturing color correction, effective image segmentation, and calculation of a browning index, which was tested as a predictor of quality and shelf life of fresh-cut romaine lettuce. The results demonstrated that machine vision software can be implemented to replace or supplement the scoring of a trained panel and instrumental quality measurements. Overall visual quality, a key sensory parameter that determines food preferences and consumer behavior, was highly correlated with the browning index, with a Pearson correlation coefficient of −0.85. Other important sensory decision parameters were also strongly or moderately correlated with the browning index, with Pearson correlation coefficients of −0.84 for freshness, 0.79 for off odor, and 0.57 for browning. The ranking of the accessions according to quality acceptability from the sensory evaluation produced a similar pattern to those obtained with the CVS. This study revealed that multiple lettuce accessions can be effectively benchmarked for their performance as fresh-cut sources via a CVS-based method. Future opportunities and challenges in using machine vision image processing to predict consumer preferences for RTE salad greens is also discussed.

1. Introduction

Ready-to-eat (RTE) salads are minimally processed and highly perishable products that are more vulnerable to quality degradation compared to their whole vegetable counterparts [1]. Quality (e.g., flavor, color, texture) degradation in fresh-cut produce can be attributed to multiple factors, including biochemical reactions, microbial spoilage, and physiological changes [2,3,4,5,6,7,8].
In the United States, sales of RTE salads became prominent in the produce sections of retail outlets over two decades ago [9,10]. The popularity of these products has coincided with increased demand for romaine lettuce [11]. The growing consumer interest and craving for romaine lettuce has presented challenges for fresh-cut processors, given the tendency of romaine lettuce to rapidly develop brown tissue on cut surfaces [12,13].
Postharvest technology has been developed to slow down the perishability of RTE leafy greens. This has included the identification of adequate polymer films and storage temperatures to ensure optimum gas composition in the passive/active modified atmosphere produced in the headspace of the packages [14,15,16,17,18,19], novel processing technology to cut and drain the product [20], and sanitizing systems that can prolong quality [21,22,23]. One of the latest approaches that aims to maximize postharvest quality across the supply chain is the development of improved breeding lines [3,24]. While traditional vegetable breeding programs have focused on improved disease tolerance and harvest yields, the growing sophistication of consumers and the evolution of RTE products have prompted more attention to breeding programs that target postharvest shelf life and RTE quality [25,26,27]. For example, diverse accessions of romaine lettuce with improved shelf life in modified atmosphere packaging (MAP) are being developed [19,28,29].
Postharvest quality of romaine lettuce is highly dependent on the degree of browning. Brown tissue is caused by the oxidation of polyphenols, accelerated by enzymatic reactions that involve polyphenol oxidase (PPO), phenylalanine ammonia lyase (PAL), and peroxidase (POD) [3,8]. Browning of fresh produce is critical in driving consumer behavior. It is widely accepted that consumers make purchasing decisions on RTE products based on the overall visual quality and extent of browned tissue [30], while likability of the product may be based on secondary factors, such as freshness and green color [31,32].
Postharvest performance of lettuce is affected by multiple factors, including its genetic constitution inherited from the parents and the environment during production, processing, and storage. Because of this extensive variability within and across production seasons, it is necessary to determine effective ways to assess the quality of the final product [19,29,33]. The need for a rapid and reliable way to predict consumers perception for quality and their preferences has become a priority for researchers and sensory professionals. The goal is to reduce time and its associated costs in implementing traditional methods that rely on instrumental quality measurements and trained panelists or large consumer panel assessments [23,34,35]. This goal can be achieved by substituting human involvement in sensory evaluations with approaches based on computer vision systems (CVS). Advancements in digital technology and CVS, which includes highly accurate segmentation of images [36,37,38,39,40,41], provide a promising outlook for rapid and accurate assessment of postharvest quality.
A wide variety of machine learning-based methods for image processing have recently emerged that can potentially be used for assessing the quality of fresh produce. These approaches have started to be tested on leafy greens, including lettuce. For example, a CVS fed with a machine learning method (support vector machine) was recently used with 70% effectiveness in predicting when spinach would wilt using CIELAB color space to recognize changing color during postharvest storage [42].
The objective of this study was to determine whether digital image analyses can be effectively used to screen raw romaine lettuce cultivated at different growing seasons. To do so, the precision of the researched method was tested on a set of commercial lettuce cultivars and newly developed breeding lines.

2. Materials and Methods

2.1. Romaine Lettuce Processing and Packaging

Romaine lettuce was grown at the U.S. Department of Agriculture, Agricultural Research Service, Sam Farr United States Crop Improvement and Protection Research Center, in Salinas, CA, USA, using the standard agronomical practices for the area. A group of 15 accessions was evaluated (Figure 1) and consisted of 12 commercial cultivars (Braveheart, Clemente, Green Forest, Green Towers, Hearts Delight, King Henry, Lobjoits, Parris Island Cos, Siskiyou, Sun Valley, Tall Guzmaine, and Triple Threat), 2 breeding lines (RH11-1506 and SM13-R2), and a single plant introduction (PI 491224). After harvesting, the lettuce was cooled to 5 °C with forced air cooling and shipped to the USDA Food Quality Laboratory (FQL) at the Beltsville Agricultural Research Center (BARC) in Beltsville, MD, USA, in a commercial refrigerated truck (2–4 °C) within 3 d of harvest. Upon arrival at the FQL, the lettuce was transferred to a 5 °C cold room for 1 d before processing, packaging, and quality assessment.
Outer leaves were manually removed from each lettuce head, and the stems and tops were trimmed off. The trimmed lettuce was cut into 2.5 × 2.5 cm squares using a pilot-scale cutter (Nichimo Seven Chefs ECD-302, Tokyo, Japan), washed for 30 s in a 100 mg L−1 NaClOH adjusted to pH 6.5 with HCl (1 mol L−1), and centrifugally dried for 2 min at 666 rev min−1 using a pilot-scale dryer (Model T-304, Meyer Machine Co., San Antonio, TX, USA). Lettuce (128 g) was packaged in 22.9 × 15.3 cm polypropylene bags (Packaging Concept Inc., Salinas, CA, USA) with a film oxygen transmission rate at 5 °C of 16.6 pmol O2 s−1 m−2 Pa−1 [17]. Packaged lettuce (4 replicates.) was stored at 5 °C for up to 14 d for quality assessment.

2.2. Sensory Evaluation

Lettuce sensory evaluation was performed by six trained panelists recruited from BARC. The panel members were 50% female and 50% male, ranging from 25 to 55 years of age. Before sample evaluation, the panelists were trained to visually assess differences in freshness, browning, off-odor (olfactory evaluation), and the overall visual quality (OVQ) using fresh-cut lettuce samples with diverse degrees of the targeted quality parameters [23]. All quality parameters were rated on a 0–100 scale. Freshness was rated based on the appearance of the sample, with 100 being the freshest. Samples with the lowest rating referred to cuts that were limp, wilted, discolored, damaged, and/or decayed [23]. Browning was rated based on the appearance of the cut edge, excluding decay or decomposition (soaked dark tissue), with a score of 0 linked to the absence of browning tissue. During the training period, the sensory panel facilitator worked with panelists to develop a pictorial intensity scale for browning (Figure 2) that was used as a reference during sample evaluation. Off-odor ratings were determined by sniffing the cuts and detecting the presence of unusual aroma, with a score range in which 0 was equivalent to no off odor. OVQ was rated based on the general appeal of the lettuce sample, combining all potential aspects that could form the sensory quality of the product, with 100 indicating an outstanding or maximum overall visual quality.
Sensory evaluations were performed inside a temperature-controlled room (22 °C) with incandescent lighting. The lettuce samples were rated for freshness, browning, and overall visual quality 3, 7, and 14 days after processing. Off odor was only rated 14 days after processing. Any further comments from the trained panelists about the samples were also recorded. The panelists evaluated 15 samples in a randomized order during each of the sessions. The lettuce samples were removed from the original packaging and placed on white trays labeled with random three-digit numbers. In between samples, the panelists sniffed coffee beans to recalibrate their sense of smell [43,44]. One sample included the entire contents of a lettuce package (128 g), and four replicate samples of each lettuce accession were evaluated at each time point by each panelist. In total, 12 separate evaluation sessions were organized to conduct the sensorial quality assessments of all the lettuce samples in this study.

2.3. Color and Browning Assessment

Lettuce sample color and browning severity was quantified using a computer vision system (Figure 3A) including a computer, camera, and controlled lighting inside an enclosed box to block ambient light, and subsequent image post-processing and analysis [8,29,45]. The controlled lighting consisted of two sets of light-emitting diodes (LEDs) (5600 K daylight balanced, high color-rendering index) with diffusers (Amazon Basics Portable Photo Studio, Amazon, Seattle, WA, USA). Each lettuce sample (4 replicates) was photographed on a matte white background by spreading out the contents of a package (128 g) across a 40.5 × 21.5 cm area. As described by Teng et al. [8], image acquisition software (Nikon Camera Capture 2.0, Nikon Inc., Melville, NY, USA) was used with a laptop computer (Dell Precision 7720, Dell Inc., Round Rock, TX, USA) to control the camera (Nikon D 800, 60 mm lens, Nikon Inc., Melville, NY, USA) with settings (F-20, 1/30 s, ISO 640, high-quality raw file format (.nef)) that were determined to be optimal using a 24 color reference card (X-rite ColorChecker® Passport, X-rite Inc., Grand Rapids, MI, USA).
Image post-processing started with a color correction using the previously described color card with the ColorChecker Camera Calibration software (v1.1.2, X-rite Inc., Grand Rapids, MI, USA) and Adobe Lightroom (version 6.3, Adobe Systems Inc., San Jose, CA, USA), followed by exporting photographs in a high-quality (uncompressed) .tiff format [8,29]. Images were segmented and analyzed using Image Pro Premier software (v.9.3b, Media Cybernetics, Inc., Rockville, MD, USA) with the smart segmentation tool. This machine learning software tool was used to develop a new method to segment lettuce images by classifying pixels into categories based on defined reference objects for each category. The categories in this method included background areas, regular pieces (dark green leaves, ribs, and inner leaves), and browned pieces (light, medium, dark) (Figure 3B). The segmentation method was created using images from preliminary trials, and the same method was then applied to all the sample photographs in this study. When analyzing a sample photograph, each pixel in the image was compared to the values of the reference object. Then, a multi-dimensional weighted Euclidian distance was calculated between the image pixel value and the reference values, allowing the pixel to be assigned to the class of the closest reference object using the software program.
The number of pixels in each category and the average RGB color of each category was calculated with the Image Pro Premier software (v.9.3b) and converted to L*a*b* (CIELAB 1976) with MATLAB (“rgb2lab” function, Image Processing Toolbox, v.R2017b, MathWorks, Natick, MA, USA). Following that, the values of hue angle (h°) and chroma (C) were calculated from a* and b* with standard equations hue angle = tan−1 [(b*) (a*)−1] and chroma = [(a*)2 + (b*)2]0.5 [46,47,48].
The overall weighted average color (L*, a*, b*, or h°) of each lettuce sample was calculated by combining the average colors from each category based on their relative amounts:
W e i g h t e d   a v e r a g e   c o l o r = P i x e l s c a t e g o r y × C o l o r c a t e g o r y
where Pixelscategory is the fraction of pixels (0–1) in each category (dark green leaves, ribs, and inner leaves; light brown, medium brown, dark brown), and Colorcategory is the average color value (L*, a*, b*, or h°) of each category (dark green leaves, ribs, and inner leaves; light brown, medium brown, dark brown). The above formula allowed us to effectively obtain an average of the pixels of only the lettuce image after segmentation, avoiding any interference with the background. Finally, a browning index value was developed to represent the visual browning severity and combine all three browning categories from the segmentation (light, medium, dark) in terms of both the extent and the intensity of browning. This browning index defined a weighting for each category of brown pixels, with darker brown-colored pixels having higher importance:
B I = P i x e l s %   d a r k   b r o w n × 4 + P i x e l s %   m e d i u m   b r o w n × 2 + P i x e l s %   l i g h t   b r o w n × 1
where Pixels% dark brown is the percent of pixels in the dark brown category, Pixels% medium brown is the percent of pixels in the medium brown category, and Pixels% light brown is the percent of pixels in the light brown category [8].

2.4. Instrumental Quality Analyses

Headspace gas composition and electrolyte leakage were quantified for each lettuce sample. Headspace gas composition inside each package was measured 3, 7, and 14 days after processing. The oxygen and carbon dioxide concentrations were measured using a headspace gas analyzer (CheckMate II, PBI Dansensor, MOCON Inc., Minneapolis, MN, USA) by inserting a needle into the package through a gas-tight septum [14,15,17].
Electrolyte leakage was determined for the samples 7 and 14 days after processing using a method adapted from Luo et al. (2004) [14] in which lettuce samples (50 g) were combined with distilled water (500 mL) at 5 °C. After 30 min, the electrolyte content was quantified with a conductivity meter (Model 135A, Orion Research Inc., Beverly, MA, USA). The total electrolyte content was measured at 5 °C after the samples were exposed to three freeze–thaw cycles, where the samples were frozen to −20 °C for 24 h, followed by defrosting at room temperature (~22 °C). The electrolyte leakage after 30 min was calculated as a percentage of the total electrolytes after the three freeze–thaw cycles [14,15,17].

2.5. Statistical Analyses

Statistical analyses were conducted with SAS v9.4 (SAS Institute Inc., Cary, NC, USA) using an analysis of variance (ANOVA) with PROC GLM. Panelists were considered to be a random effect, and storage times and cultivars were analyzed as fixed effects for these data. Comparisons of treatment means were performed using Tukey–Kramer least significant difference tests, with significance defined as p < 0.05. Pearson correlation coefficients (PCCs) were calculated to determine the strength of the linear relationships between sensory and instrumental quality attributes; a PCC of >0.7 was interpreted as a strong correlation between variables, the 0.5–0.7 range indicated a moderate correlation, and <0.5 was considered a weak correlation. Principal component analysis was conducted to describe the relationship between attributes using latent factors that involved mean centering the data, disintegrating the data using eigenvalues, and nominating factors with the Scree test using PROC FACTOR in SAS v9.4 [29,49]. SigmaPlot v.13 (Systat Software, Inc., San Jose, CA, USA) was employed to graph the relationships between variables [40,50].

3. Results and Discussion

3.1. Sensory Evaluation

Sensory quality rating determined by panelists during storage time produced significant differences, particularly on days 7 and 14 after processing (Figure 4). Differences in late storage days of evaluations are common as imperfections become more visible once signs of deterioration due to higher respiration, cell lysis, and re-dox activity emerge [8,51]. The overall visual quality of all accessions was above 80 at day 3; however, acceptability decreased by day 7, and five of the accessions (Sun Valle, Green Forest, RH11-506, Tall Guzmaine, and Triple Threat) had an acceptability lower than 80. At day 14, all accessions had an acceptability of 60 to 80, with exception of PI 491224 and Triple Threat, which had lower acceptability scores (Figure 4A). Freshness scores showed a similar trend, with all accessions having an almost perfect score three days after processing, and a score of around 80 seven days after processing. The freshness scores for most accessions continued to decrease gradually to around 70, 14 days after processing; PI 491224 and Triple Threat had more rapid decreases at 14 days after processing (Figure 4B), with freshness scores of 60 and 20, respectively. The browning of tissue increased with the increasing number of days in storage. Three days after processing, all accessions had a browning score of less than 5. Seven days after processing, all accessions had scores of less than 16 for browning, except for Green Forest and RH11-1506, which had higher brown scores of 20 and 19, respectively. Fourteen days after processing, Sun Valley, Green Forest SM13-R2, Siskiyou, RH11-1506, Tall Guzmaine, Lobjoits, and King Henry had browning scores greater than 30, while the remaining accessions had browning scores of 10 to 30 (Figure 4C).
The above results suggest that panelists were not significantly influenced by the perception of browning tissues (at least below a certain undetermined threshold) when rating the overall visual quality of the samples. Freshness followed a similar trend as OVQ, indicating that these two traits are perceived similarly when assessing fresh-cut romaine lettuce. Another possible explanation is that the perception of freshness is a key determinant of a consumer’s evaluation of acceptability. Similar results have been observed when assessing diverse fresh produce [32,40], which have been linked more to the luminance distribution than to color [52,53].
The panelists’ scores for off odor at day 14 (Figure 5) showed that most of the accessions had an off-odor score below 5, except for King Henry (7), Tall Guzmaine (15), PI 491224 (21), and Triple Threat (74). These results matched the trends found in freshness and acceptability; PI 491224 and Triple Threat had the greatest off-odor scores, as well as the lowest freshness and OVQ scores.
The principal component analysis using the browning and OVQ sensory data (Figure 6) showed evidence of the opposite perception for these two factors, which was expected given that consumers typically have a negative association with browning in RTE lettuce. PI 491224 was located outside of the linear correlation curve form when pairing the two factors. Triple Threat fell even farther away from the trend line, implying that those two accessions differ significantly from all other tested accessions with respect to perception of OVQ and browning. It has been previously documented that both PI 491224 and Triple Threat are highly prone to a very rapid deterioration due to physiological decay that results in dark soft tissue [48], which often occurs before or at the same time as the common phenolic oxidation and browning of tissue. This common phenolic oxidation has been the main process observed for most other lettuce cultivars and breeding lines [8,29] and the focus in this study. The unusually high physiological decay, which also carries dark tissue, may have caused these two accessions to fall outside the linear trend. Additionally, sensory panelists were instructed to score browning of the lettuce samples based on the appearance of cut-edge browning only, excluding decay or decomposition. This explains why PI 491224 and Triple Threat showed lower browning scores while also a high level of decay.

3.2. Color and Browning Severity

When comparing the differences observed in incidence and severity of browning across accessions via CVS and image analysis (Figure 7), the accession with the least amount of browning was Clemente, with the lettuce pixels being identified as 69.4% regular pieces, 25.9% light brown, 3.3% medium brown, and 1.0% dark brown. On the opposite end of the spectrum, Triple Threat had the most browning, with the lettuce pixels having 53.6% regular pieces, 31.3% light brown, 7.0% medium brown, and 5.3% dark brown. The percent of light brown pixels was used to group the accessions into four phenotypic clusters: 1. Clemente (least browning group); 2. Parris Island Cos, Hearts Delight, Green Towers, Brave Heart, and PI 491224; 3. Sun Valley, Green Forest, RH11-1506, Lobjoits, SM13-R2, and Triple Threat; and 4. Siskiyou, Tall Guzmaine, and King Henry (most browning group). There was ≥3% difference between each group. When medium brown or dark brown pixel data were used for the analysis, only Triple Threat showed a uniquely high level of browning. Light browning is associated with physiological oxidation, and it is commonly observed in a dry state before decay begins [28]. On the other hand, dark browning is generally associated with the appearance of water-soaked tissue due to physiological deterioration and/or microbial decay [54,55], which was the process observed in Triple Threat in this and previous studies [8]. This observation indicates that the categorization of browning through image segmentation is an effective approach to quickly identify samples with a rapid rate of decay after processing.
When all the color categories were taken into consideration jointly through the empirically developed browning index, a clearer (statistical) differentiation was possible among some of the accessions. Tall Guzmaine, King Henry, and Triple Threat in general showed higher brown tissue than that in Clemente, Hearts Delight, and Parris Island Cos (Figure 8). Other differences within clusters were not observed due to data variability and subsequent standard deviations. However, the browning index was useful for providing a ranking of accessions that could be compared with the ranking produced by sensory panelists. With a few exceptions, a similar ranking of the accessions was produced using the browning index and visual evaluations by the panelists (Figure 4 and Figure 8).

3.3. Quality Parameters Determined by Instruments

No significant difference was observed among accessions in oxygen depletion, which was likely due to a significant effect of both MAP and refrigerated conditions in all samples. Likewise, the carbon dioxide content in the headspace of all 13 accessions was similar. The only exceptions were PI 491224 and Triple Threat, which had a significantly higher CO2 concentration (Figure 9). The higher accumulation of CO2 in samples of these two accessions could be associated with enzyme activity and phenolic composition [56], and/or microbial growth [57] commonly associated with soft decay and electrolyte leakage. Electrolyte leakage values showed similar results as the CO2 analyses.
Electrolyte leakage measured 7 and 14 days after processing ranged from 0.7 to 1.5% for all accessions except Triple Threat, which had a significantly higher electrolyte leakage (12.4 to 14.1%) at both evaluation times, and PI 491224, which had higher electrolyte leakage (4.6%) at 14 days after processing (Figure 10). Both CO2 concentration and electrolyte leakage values confirmed that these two cultivars are very highly prone to tissue deterioration due to cell lysis. The early stage of the deterioration process that is manifested as water-soaked, dark tissue areas was successfully captured by the image segmentation approach. The results of the CVS segmentation approach agree with those obtained using hyperspectral imaging and chlorophyll fluorescence imaging [58].

3.4. Relationships between Attributes

The main goal of the study was to determine whether a browning index derived from CVS could be used for a rapid assessment of the quality of fresh-cut lettuce. BI produced noteworthy correlations, with the key factors driving sensory and quality perception of panelists (and potentially also consumers). In particular, BI showed a strong correlation with freshness (r = −0.84), OVQ (r = −0.85) and off odor (r = 0.79) (Figure 11). Aside from our main objective of determining to what extent the empirical index could be of use, the variables measured with instrumentation (CO2, O2, electrolyte leakage) highly correlated with off odor, suggesting the importance of microbiological deterioration, as mentioned before.
There are many opportunities to apply machine learning and computer vision approaches to allow for non-destructive quality assessment of food products, including techniques such as support vector machine, K-nearest neighbor, decision trees, artificial neural networks, and convolutional neural networks [59]. The analysis of digital images as a quality evaluation tool can create new, more cost-effective alternatives to traditional sensory assessments of fresh produce in research and commercial settings, especially since techniques could be developed to work with images captured with cheaper point-and-shoot cameras or smartphones. While variables such as texture and aroma limit the use of this technology for some fruits, the power of images still appears to be significant to forecast in-situ preferences and eventually influence online consumers and e-grocery trends [60].
Our work adds to emerging reports that showed good performance of CVS-based models to predict quality in leafy vegetables without panelists’ in-situ intervention. For example, quality and deterioration of fresh-cut lettuce in clear plastic bags was well correlated using hyperspectral and chlorophyll fluorescence imaging approaches [58] and with a deep learning architecture based on a convolutional neural network [61]. Likewise, our study showed that browning quantified through image analysis was highly correlated to freshness, a subjective but critical factor in consumers’ decision-making at the point of purchase. The browning index developed in this study, or a modification of it, could be furthered in the future to predict overall product acceptability and freshness. This opens the possibility for fresh produce suppliers to virtually showcase a quality trait (freshness) associated with good postharvest handling techniques and timely coordination from field to retail and/or the local supply chain. Koyama et al. [42] also recently reported an effective model to predict consumers’ perception of the freshness of baby spinach. Their results assessing product freshness suggest that while using images for sensory analysis has limitations, it confirmed that machine learning and digital image analysis facilitate the assessment of a quality variable that is often influenced by light conditions in the room (i.e., lab or retail outlet). Novel apps that allow straightforward changes to a photograph background and improved technology to capture 360° and 3D images warrant further research to elucidate ways to maximize the use of electronic images in food-quality assessment. Such CVS-based approaches may be able to replace or limit the overreliance on panelists and instrumentation analysis to screen raw materials and track quality during postharvest handling processes.

4. Conclusions

This study demonstrated that the postharvest quality of romaine lettuce can be effectively evaluated using computer vision and image analysis techniques. We developed a CVS-based method that generated browning parameters that were highly correlated to key sensory attributes such as OVQ and freshness. The CVS results also agreed with results obtained with instrumentation (i.e., headspace gas composition and electrolyte leakage). Overall, the findings from this study illustrate a practical alternative to expedite screening for raw materials of RTE salads, which can be of potential application in the fresh-cut produce industry and breeding research programs.

Author Contributions

Conceptualization, E.R.B. and Y.L.; Methodology, E.R.B.; Software, E.R.B.; Validation, F.T. and J.M.F.; Formal analysis, E.R.B. and E.P.; Investigation, E.R.B., E.P., E.R.T., Z.T. and F.T.; Resources, Y.L., B.Z. and I.S.; Data curation, E.R.B., E.P., B.Z. and I.S.; Writing—original draft, E.R.B. and E.P.; Writing—review & editing, E.R.B., Y.L., B.Z., E.R.T., Z.T., F.T., I.S. and J.M.F.; Visualization, E.R.B. and Y.L.; Supervision, Y.L. and J.M.F.; Project administration, Y.L. and J.M.F. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Data are contained within the article.

Acknowledgments

The authors thank the panelists who evaluated the lettuce samples, Brooke T. Hutton, and Vaidehi Bhagat, for their technical support. All opinions expressed in this paper are the authors and do not necessarily reflect the policies and views of USDA, ARS, DOE, or ORAU/ORISE. Mention of trade names or commercial products in this publication is solely for the purpose of providing specific information and does not imply recommendation or endorsement by the USDA.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Nicola, S.; Fontana, E. Fresh-cut produce quality: Implications for a systems approach. In Postharvest Handling, 3rd ed.; Florkowski, W.J., Shewfelt, R.L., Brueckner, B., Prussia, S.E., Eds.; Academic Press-Elsevier Inc.: Cambridge, MA, USA, 2014; pp. 217–273. ISBN 9780124104358. [Google Scholar]
  2. Cubero, S.; Aleixos, N.; Moltó, E.; Gómez-Sanchis, J.; Blasco, J. Advances in machine vision applications for automatic inspection and quality evaluation of fruits and vegetables. Food Bioprocess Technol. 2011, 4, 487–504. [Google Scholar] [CrossRef]
  3. Hunter, P.J.; Atkinson, L.D.; Vikcer, L.; Lignou, S.; Oruna-Concha, M.J.; Pink, D.; Hand, P.; Barker, G.; Wagstaff, C.; Monaghan, J.M. Oxidative discoulouration in whole-head and cut lettuce: Biochemical and environmental influences on a complex phenotype and potential breeding strategies to improve shelf-life. Euphytica 2017, 213, 180. [Google Scholar] [CrossRef] [PubMed]
  4. Garitta, L.; Hough, G.; Chaves, A. Sensory analysis of broccoli over time: Consumer defined critical attributes and evaluation of digital photographs in comparison to real product appearance. Food Qual. Prefer. 2013, 29, 48–52. [Google Scholar] [CrossRef]
  5. Jackman, P.; Sun, D.W. Recent advances in image processing using image texture features for food quality assessment. Trends Food Sci. Technol. 2013, 29, 35–43. [Google Scholar] [CrossRef]
  6. Choi, Y.J.; Tomás-Barberán, T.A.; Saltveit, M.E. Wound-induced phenolic accumulation and browning in lettuce (Lactuca sativa L.) leaf tissue is reduced by exposure to n-alcohols. Postharvest Biol. Technol. 2005, 37, 47–55. [Google Scholar] [CrossRef]
  7. Qadri, O.S.; Yousuf, B.; Srivastava, A.K. Fresh-cut fruits and vegetables: Critical factors influencing microbiology and novel approaches to prevent microbial risks—A review. Cogent Food Agric. 2015, 1, 1121606. [Google Scholar] [CrossRef]
  8. Teng, Z.; Luo, Y.; Bornhorst, E.R.; Zhou, B.; Simko, I.; Trouth, F. Identification of romaine lettuce (Lactuca sativa var. longifolia) Cultivars with reduced browning discoloration for fresh-cut processing. Postharvest Biol. Technol. 2019, 156, 110931. [Google Scholar] [CrossRef]
  9. Glaser, L.K.; Thompson, G.D.; Handy, C.R. Recent Changes in Marketing and Trade Practieces in the U. S. Lettuce and Fresh-Cut Vegetables Industries; Agr. Info. Bull. No. 767; US Department of Agriculture, Economic Research Service: Washington, DC, USA, 2001. [CrossRef]
  10. Janick, J.; Whipkey, A. (Eds.) Trends in New Crops and New Uses; ASHS Press: Alexandria, VA, USA, 2002; pp. 153–156. [Google Scholar]
  11. Davis, W.; Lucier, G. Vegetable and Pulses Outlook: April 2021; US Depatment of Agriculture, Economic Research Service: Washington, DC, USA, 2021.
  12. Hodges, D.M.; Tolvonen, P.M.A. Quality of fresh-cut fruits and vegetables as affected by exposure to abiotic stress. Postharvest Biol. Technol. 2008, 48, 155–162. [Google Scholar] [CrossRef]
  13. Degl’innocenti, E.; Guidi, L.; Paradossi, A.; Tognoni, F. Biochemical study of leaf browning in minimally processed leavesof lettuce (Lactuca sativa L. var. Acephala). J. Agric. Food Chem. 2005, 52, 9980���9984. [Google Scholar] [CrossRef] [PubMed]
  14. Luo, Y.; McEvoy, J.L.; Wachtel, M.R.; Kim, J.G.; Hung, Y. Package Atmosphere Affects postharvest biology and quality of fresh-cut Cilantro Leaves. HortScience 2004, 39, 567–570. [Google Scholar] [CrossRef]
  15. Luo, Y. Wash operation affect water quality and packaged fresh-cut romaine lettuce quality and microbial growth. HortScience 2007, 42, 1413–1419. [Google Scholar] [CrossRef]
  16. Kim, J.G.; Luo, Y.; Gross, K.C. Effect of package film on the quality of fresh-cut salad savoy. Postharvest Biol. Technol. 2004, 32, 99–107. [Google Scholar] [CrossRef]
  17. Kim, J.G.; Luo, Y.; Saftner, R.A.; Gross, K.C. Delayed modified atmosphere packaging of fresh-cut Romaine lettuce: Effects on quality maintenance and shelf-life. J. Am. Soc. Hortic. Sci. 2005, 130, 116–123. [Google Scholar] [CrossRef]
  18. Simko, I.; Hayes, R.J.; Truco, M.; Michelmore, R.W.; Antonise, R.; Massoudi, M. Molecular markers reliably predict postharvest deterioration of fresh-cut lettuce in modified atmosphere packaging. Hortic. Res. 2018, 5, 21. [Google Scholar] [CrossRef]
  19. Peng, H.; Sthapit Kandel, J.; Michelmore, R.W.; Simko, I. Identification of factors affecting the deterioration rate of fresh-cut lettuce in modified atmosphere packaging. Food Bioprocess Technol. 2020, 13, 1997–2011. [Google Scholar] [CrossRef]
  20. Toivonen, P.M.A.; Brummell, D. Biochemical bases of appearance and texture changes in fresh-cut fruit and vegetables. Postharvest Biol. Technol. 2008, 48, 1–14. [Google Scholar] [CrossRef]
  21. Lopez-Galvez, F.; Ragaert, P.; Palermo, L.A.; Eriksson, M.; Devlieghere, F. Effect of new sanitizing formulations on quality of fresh-cut iceberg lettuce. Postharvest Biol. Technol. 2013, 85, 102–108. [Google Scholar] [CrossRef]
  22. Luna, M.C.; Tudela, J.A.; Martínez-Sánchez, A.; Allende, A.; Gil, M.I. Optimizing water management to control respiration rate and reduce browning and microbial load of fresh-cut romaine lettuce. Postharvest Biol. Technol. 2013, 80, 9–17. [Google Scholar] [CrossRef]
  23. Bornhorst, E.R.; Luo, Y.; Park, E.; Vinyard, B.T.; Nou, X.; Zhou, B.; Turner, E.; Millner, P.D. Immersion-free, single-pass, commercial fresh-cut produce washing system: An alternative to flume processing. Postharvest Biol. Technol. 2018, 146, 124–133. [Google Scholar] [CrossRef]
  24. Simko, I.; Hayes, R.J.; Mou, B.; McCreight, B. Lettuce and Spinach. In Yield Gains in Major US. Field Crops; Smith, S., Diers, B., Specht, J., Carver, B., Eds.; American Society of Agronomy Inc., Crop Science Society of America, Inc., and Soil Science Society of America, Inc.: Madison, WI, USA, 2014; Volume 3, pp. 53–85. ISBN 978089186205. [Google Scholar]
  25. Atkinson, L.D.; McHale, L.K.; Truco, M.J.; Hilton, H.W.; Lynn, J.; Schut, J.W.; Michelmore, R.W.; Hand, P.; Pink, D.A. An intra-specific linkage map of lettuce (Lactuca sativa) and genetic analysis of postharvest discolouration traits. Theor. Appl. Genet. 2013, 126, 2737–2752. [Google Scholar] [CrossRef]
  26. Hayes, R.J.; Simko, I. Breeding leettuce for improved fresh-cut processing. Acta Hortic. 2016, 1141, 65–76. [Google Scholar] [CrossRef]
  27. Liu, Z.; Sun, J.; Teng, Z.; Luo, Y.; Yu, L.; Simko, I.; Chen, P. Identification of marker compounds for predicting browning of fresh-cut lettuce using untargeted UHPLC-HRMS metabolomics. Postharvest Biol. Technol. 2021, 180, 111626. [Google Scholar] [CrossRef]
  28. Rivera, J.R.E.; Stone, M.B.; Stushnoff, C.; Pilon-Smits, E.; Kendall, P.A. Effects of ascorbic acid applied by two hydrocooling methods on physical and chemical properties of green leaf lettuce stored at 5 C. J. Food Sci. 2006, 71, S270–S276. [Google Scholar] [CrossRef]
  29. Peng, H.; Luo, Y.; Teng, Z.; Zhou, B.; Bornhorst, E.R.; Fonseca, J.M.; Simko, I. Phenotypic characterization and inheritance of enzymatic browning on cut surfaces of stems and leaf ribs of romaine lettuce. Postharverst Biol. Technol. 2021, 181, 111653. [Google Scholar] [CrossRef]
  30. Zhou, T.; Harrison, A.D.; McKellar, R.; Young, J.C.; Odumeru, J.; Piyasena, P.; Lu, X.; Mercer, D.G.; Karr, S. Determination of acceptability and shelf life of ready-to-use lettuce by digital image analysis. Int. Food Res. J. 2004, 37, 875–881. [Google Scholar] [CrossRef]
  31. Løkke, M.M.; Seefeldt, H.F.; Edelenbos, M. Freshness and sensory quality of packaged wild rocket. Postharvest Biol. Technol. 2012, 73, 99–106. [Google Scholar] [CrossRef]
  32. Wada, Y.; Arce-Lopera, C.; Masuda, T.; Kimura, A.; Dan, I.; Goto, S.; Tsuzuki, D.; Okajima, K. Influence of luminance distribution on the appetizingly fresh appearance of cabbage. Appetite 2010, 54, 363–368. [Google Scholar] [CrossRef]
  33. Bolin, H.R.; Huxsoll, C.C. Effect of preparation procedures and storage parameters on quality retention of salad-cut lettuce. J. Food Sci. 1991, 56, 60–67. [Google Scholar] [CrossRef]
  34. Simko, I.; Hayes, R.J. Accuracy, reliability, and timing of visual evaluations of decay in fresh-cut lettuce. PLoS ONE 2018, 13, e0194635. [Google Scholar] [CrossRef] [PubMed]
  35. McWatters, K.H.; Chinnan, M.S.; Walker, S.L.; Doyle, M.P.; Lin, C.M. Consumer acceptance of fresh-cut iceberg lettuce treated with 2% hydrogen peroxide and mild heat. J. Food Prot. 2002, 65, 1221–1226. [Google Scholar] [CrossRef]
  36. Arias, E.; Oria, R.; López-Buesa, P. Determination of acceptability and shelf life of fresh-cut pear by digital image analysis. J. Food Meas. Charact. 2018, 12, 2916–2926. [Google Scholar] [CrossRef]
  37. Brosnan, T.; Sun, D.-W. Improving quality inspection of food products by computer vision—A review. J. Food Eng. 2004, 61, 3–16. [Google Scholar] [CrossRef]
  38. Manninen, H.; Paakki, M.; Hopia, A.; Franzen, R. Measuring the green color of vegetables from digital images using image analysis. Food Sci. Technol. 2015, 63, 1184–1190. [Google Scholar] [CrossRef]
  39. Nandhini, P.; Jaya, J.; George, J. Computer vision system for food quality evaluation-a review. In Proceedings of the 2013 International Conference on Current Trends in Engineering and Technology (ICCTET), Coimbatore, India, 3 July 2013; pp. 85–87. [Google Scholar]
  40. Pace, B.; Cefola, M.; Da Pelo, P.; Renna, F.; Attolico, G. Non-destructive evaluation of quality and ammonia content in whole and fresh-cut lettuce by computer vision system. Int. Food Res. J. 2014, 64, 647–655. [Google Scholar] [CrossRef]
  41. Pace, B.; Cefola, M.; Cavallo, D.P.; Attolico, G. Automatic procedure to contactless and non-destructive quality evaluation of fruits and vegetables through a computer vision system. Acta Hortic. 2019, 1311, 99–106. [Google Scholar] [CrossRef]
  42. Koyama, K.; Tanaka, M.; Cho, B.H.; Yoshikawa, Y.; Koseki, S. Predicting sensory evaluation of spinach freshness using machine learning model and digital images. PLoS ONE 2021, 16, e0248769. [Google Scholar] [CrossRef] [PubMed]
  43. Ward, C. Some like it hot! Sensory analysis of products containing chemesthetic compounds. In Chemesthesis: Chemical Touch in Food and Eating, 1st ed.; McDonald, S.T., Bolliet, D.A., Hayes, J.E., Eds.; John Wiley & Sons, Inc. (Wiley): Hoboken, NJ, USA, 2016; pp. 154–163. ISBN 978-1-118-95173-6. [Google Scholar]
  44. Thompson, T.W.; Geornaras, I.; Delmore, R.J.; McFarlane, B.J.; Belk, K.E.; Nair, M.N. Investigating the Etiology of Sour Knuckles in Postchilled Beef Carcasses. Meat Muscle Biol. 2020, 4, 1–9. [Google Scholar] [CrossRef]
  45. Srinivasagan, N.S.; Sunjoh, S.; Xue, J.; Bora, G.C. Quantification of browning in apples using colour and textrual features by image analysis. Food Qual. Saf. 2017, 1, 221–226. [Google Scholar]
  46. Saftner, R.A.; Abbott, J.A.; Lester, G.; Vinyard, B. Sensory and analytical comparison of orange-fleshed honeydew to cantaloupe and green-fleshed honeydew for fresh-cut chunks. Postharvest Biol. Technol. 2006, 42, 150–160. [Google Scholar] [CrossRef]
  47. Saftner, R.A.; Lester, G.E. Sensory and analytical characteristics of a novel hybrid muskmelon fruit intended for the fresh-cut industry. Postharvest Biol. Technol. 2009, 51, 327–333. [Google Scholar] [CrossRef]
  48. Simko, I.; Hayes, R.J.; Kramer, M. Computing integrated ratings from heterogeneous phenotypic assessments: A case study of lettuce postharvest quality and downy mildew resistance. Crop Sci. 2012, 52, 2131–2142. [Google Scholar] [CrossRef]
  49. Saftner, R.A.; Polashock, J.; Ehlenfeldt, M.; Vinyard, B. Instrumental and sensory quality characteristics of blueberry fruit from twelve cultivars. Postharvest Biol. Technol. 2008, 49, 19–26. [Google Scholar] [CrossRef]
  50. Park, E.; Luo, Y.G.; Marine, S.C.; Everts, K.L.; Micallef, S.A.; Bolten, S.; Stommel, J. Consumer preference and physicochemical evaluation of organically grown melons. Postharvest Biol. Technol. 2018, 141, 77–85. [Google Scholar] [CrossRef]
  51. Juzenas, P.; Moan, J. Singlet oxygen in photosensitization. J. Environ. Pathol. Toxicol. 2006, 25, 1–2. [Google Scholar] [CrossRef] [PubMed]
  52. Motoyoshi, I.; Nishida, S.; Sharan, L.; Adelson, E.H. Image statistics and the perception of surface qualities. Nature 2007, 447, 206–209. [Google Scholar] [CrossRef] [PubMed]
  53. Murakoshi, T.; Masuda, T.; Utsumi, K.; Tsubota, K.; Wada, Y. Glossiness and perishable freshness judgment of fish eyes based on luminance distribution. PLoS ONE 2013, 8, e58994. [Google Scholar] [CrossRef]
  54. Fonseca, J.M. Postharvest quality and microbial population of head lettuce as affected by moisture at harvest. J. Food Sci. 2006, 71, M45–M49. [Google Scholar] [CrossRef]
  55. Hayes, R.J.; Liu, Y.B. Genetic variation for shelf-life of salad-cut lettuce in modified-atmosphere environments. J. Am. Soc. Hortic. Sci. 2008, 133, 228–233. [Google Scholar] [CrossRef]
  56. Leonard, S.R.; Simko, I.; Mammel, M.K.; Ricther, T.K.S.; Brandl, M.T. Seasonality, shelf life and storage atmosphere are main drivers of the microbiome and E. coli O157:H7 colonization of post-harvest lettuce cultivated in a major production area in California. Environm Microb. 2021, 16, 25. [Google Scholar] [CrossRef] [PubMed]
  57. Caleb, O.J.; Mahajan, P.V.; Al-Said, F.A.; Opara, U.L. Modified atmosphere packaging technology of fresh and fresh-cut produce and the microbial consequences—A review. Food Bioprocess. Technol. 2013, 6, 303–329. [Google Scholar] [CrossRef]
  58. Simko, I.; Jimenez-Berni, J.A.; Furbank, R.T. Detection of decay in fresh-cut lettuce using hyperspectral imaging and chlorophyll fluorescence imaging. Post. Biol. Technol. 2015, 106, 44–52. [Google Scholar] [CrossRef]
  59. Hameed, K.; Chai, D.; Rassau, A. A comprehensive review of fruit and vegetable classification techniques. Image Vis. Comput. 2018, 80, 24–44. [Google Scholar] [CrossRef]
  60. Park, E.; Luo, Y.; Trouth, F.; Fonseca, J.M. Charting the future of e-grocery: An evaluation of the use of digital imagery as a sensory analysis tool for fresh fruits. Horticulturae 2021, 7, 262. [Google Scholar] [CrossRef]
  61. Cavallo, D.P.; Cefola, M.; Pace, B.; Logrieco, A.F.; Attolico, G. Non-destructive automatic quality evaluation fresh-cut iceberg lettuce through packaging material. J. Food Eng. 2018, 223, 46–52. [Google Scholar] [CrossRef]
Figure 1. Pedigree of romaine lettuce accessions and their relationships; empty boxes represent known but unnamed lettuce hybrids. Accessions evaluated in this study are in blue font.
Figure 1. Pedigree of romaine lettuce accessions and their relationships; empty boxes represent known but unnamed lettuce hybrids. Accessions evaluated in this study are in blue font.
Horticulturae 10 00731 g001
Figure 2. Browning reference scale developed by the trained panel and sensory panel facilitator with example sensory browning intensity ratings from 0 to 70.
Figure 2. Browning reference scale developed by the trained panel and sensory panel facilitator with example sensory browning intensity ratings from 0 to 70.
Horticulturae 10 00731 g002
Figure 3. Diagram of the computer vision system setup (A) and example image segmentation (B).
Figure 3. Diagram of the computer vision system setup (A) and example image segmentation (B).
Horticulturae 10 00731 g003
Figure 4. Scores (means) of sensory traits of romaine lettuce evaluated in the study. Bars represent SE. Range for the three variables; i.e., overall quality (A), freshness (B), and browning (C), is from 0 to 100.
Figure 4. Scores (means) of sensory traits of romaine lettuce evaluated in the study. Bars represent SE. Range for the three variables; i.e., overall quality (A), freshness (B), and browning (C), is from 0 to 100.
Horticulturae 10 00731 g004
Figure 5. Average incidence of off odor in the accessions evaluated, as ranked by the trained panelists 14 days after processing. Bars represent SE.
Figure 5. Average incidence of off odor in the accessions evaluated, as ranked by the trained panelists 14 days after processing. Bars represent SE.
Horticulturae 10 00731 g005
Figure 6. PCA map for the relationships between overall visual quality and browning.
Figure 6. PCA map for the relationships between overall visual quality and browning.
Horticulturae 10 00731 g006
Figure 7. Browning intensity is shown by comparing the average proportion of pixels in the photographs of lettuce samples that fall into 4 groups (regular pieces (not brown), light brown, medium brown, and dark brown) after 14 days, using image segmentation.
Figure 7. Browning intensity is shown by comparing the average proportion of pixels in the photographs of lettuce samples that fall into 4 groups (regular pieces (not brown), light brown, medium brown, and dark brown) after 14 days, using image segmentation.
Horticulturae 10 00731 g007
Figure 8. Average browning index from the image analysis for all accessions (4 replicates). Bars represent SE.
Figure 8. Average browning index from the image analysis for all accessions (4 replicates). Bars represent SE.
Horticulturae 10 00731 g008
Figure 9. Average oxygen and carbon dioxide in headspace of the packaged fresh-cut lettuce accessions (4 replicates). Bars represent SE.
Figure 9. Average oxygen and carbon dioxide in headspace of the packaged fresh-cut lettuce accessions (4 replicates). Bars represent SE.
Horticulturae 10 00731 g009
Figure 10. Electrolyte leakage (means of four replicates) produced by accessions. Three bars represent SE.
Figure 10. Electrolyte leakage (means of four replicates) produced by accessions. Three bars represent SE.
Horticulturae 10 00731 g010
Figure 11. Correlation coefficient of sensory attributes (freshness, browning, off odor, overall visual quality), browning index with color (chroma), and instrumentation variables (CO2, O2, electrolyte leakage). Sensory score includes freshness (F), browning (B), off odor (O), and over visual quality (Q). Browning index (BI). The color value is chroma (C). Instrumental analysis factors are CO2, O2, and electrolyte leakage (EL). All data correspond to results from days 3, 7, and 14 except those from EC, which are from days 7 and 14, and off-odor, which has results from day 14 only.
Figure 11. Correlation coefficient of sensory attributes (freshness, browning, off odor, overall visual quality), browning index with color (chroma), and instrumentation variables (CO2, O2, electrolyte leakage). Sensory score includes freshness (F), browning (B), off odor (O), and over visual quality (Q). Browning index (BI). The color value is chroma (C). Instrumental analysis factors are CO2, O2, and electrolyte leakage (EL). All data correspond to results from days 3, 7, and 14 except those from EC, which are from days 7 and 14, and off-odor, which has results from day 14 only.
Horticulturae 10 00731 g011
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Bornhorst, E.R.; Luo, Y.; Park, E.; Zhou, B.; Turner, E.R.; Teng, Z.; Trouth, F.; Simko, I.; Fonseca, J.M. In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions. Horticulturae 2024, 10, 731. https://doi.org/10.3390/horticulturae10070731

AMA Style

Bornhorst ER, Luo Y, Park E, Zhou B, Turner ER, Teng Z, Trouth F, Simko I, Fonseca JM. In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions. Horticulturae. 2024; 10(7):731. https://doi.org/10.3390/horticulturae10070731

Chicago/Turabian Style

Bornhorst, Ellen R., Yaguang Luo, Eunhee Park, Bin Zhou, Ellen R. Turner, Zi Teng, Frances Trouth, Ivan Simko, and Jorge M. Fonseca. 2024. "In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions" Horticulturae 10, no. 7: 731. https://doi.org/10.3390/horticulturae10070731

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop