“I was Xiaoyang’s technical mentor for her 12 week summer 2015 internship with Intuit’s Data Engineering and Analytics (IDEA) group. For her internship, Xiaoyang implemented FlowView — a big data pipeline monitoring system. Xiaoyang owned FlowView’s end-to-end implementation including product definition, customer interviews, engineering and dash-boarding. Building a tracking system for enterprise data pipelines requires tapping into multiple points in the pipeline. Despite being new to Python and Hadoop, Xiaoyang quickly absorbed architecture of an existing project and adapted it for FlowView. Her implementation used Python to manage data taps into Hadoop file system (HDFS), Hive, and a MPP analytic database at the end. Her application outputs summary statistics (percent data lost) as well as record-level details (which record-ids were lost) at every step for each tracked dataset. This capability is beneficial to our internal customers as well as data engineers. Xiaoyang embodies an effective mixture of curiosity, intellectual honesty, and perseverance. It is because of these attributes, I believe, that she was able to succeed amidst ambiguity and take a difficult project to completion in a span of 12 weeks. ”
Activity
-
Let the games begin - Family Plan is here! 👯♀️ 👯♂️ Stoked to finally get this seemingly "simple" but deceptively complex project out in the wild,…
Let the games begin - Family Plan is here! 👯♀️ 👯♂️ Stoked to finally get this seemingly "simple" but deceptively complex project out in the wild,…
Liked by Xiaoyang Qian
-
Weird flex, I know, but feeling proud of myself for hitting inbox zero for 100 weeks. Thanks Superhuman for making email more pleasant!
Weird flex, I know, but feeling proud of myself for hitting inbox zero for 100 weeks. Thanks Superhuman for making email more pleasant!
Liked by Xiaoyang Qian
-
We’re excited to announce cash deposits via barcode at retail locations 💵🏪 For many small businesses and gig workers, cash is still king. With…
We’re excited to announce cash deposits via barcode at retail locations 💵🏪 For many small businesses and gig workers, cash is still king. With…
Liked by Xiaoyang Qian
Experience & Education
-
Pulley
View Xiaoyang’s full experience
See their title, tenure and more.
or
Volunteer Experience
Languages
-
English
-
-
Mandarin
-
Recommendations received
1 person has recommended Xiaoyang
Join now to viewMore activity by Xiaoyang
-
Couldn't be more grateful and excited to have earned back my employee badge at Strava! Ready for my Strava sequel!
Couldn't be more grateful and excited to have earned back my employee badge at Strava! Ready for my Strava sequel!
Liked by Xiaoyang Qian
-
Something special is brewing at Indigo...
Something special is brewing at Indigo...
Liked by Xiaoyang Qian
-
The photographer Deanna Dikeman’s parents always stood outside to send her off after a visit, waving or standing in the driveway while she got in her…
The photographer Deanna Dikeman’s parents always stood outside to send her off after a visit, waving or standing in the driveway while she got in her…
Liked by Xiaoyang Qian
-
Support our amazing cycling team by helping reviewing a few short contracts!
Support our amazing cycling team by helping reviewing a few short contracts!
Shared by Xiaoyang Qian
-
I'm very happy to share that I started a new role as a Software Engineer at Google this week. I'll be working as part of the Google Docs team to…
I'm very happy to share that I started a new role as a Software Engineer at Google this week. I'll be working as part of the Google Docs team to…
Liked by Xiaoyang Qian
-
I’m thrilled to be speaking at the New York Product Conference on April 7th (IRL) in Manhattan! 🎉 I'll be sharing my product experience at CookUnity…
I’m thrilled to be speaking at the New York Product Conference on April 7th (IRL) in Manhattan! 🎉 I'll be sharing my product experience at CookUnity…
Liked by Xiaoyang Qian
Other similar profiles
Explore collaborative articles
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
Explore MoreOthers named Xiaoyang Qian
-
Xiaoyang Q.
Food/PetFood Industry - Engineering and Project Director
-
Xiaoyang Qian
CSE Master @UMich | DS @UMich
-
Xiaoyang Qian
CFA Charterholder, Financial Advisor at Donghai Securities
-
钱小洋
Wenzhou Aoxiang Packaging Machinery Co.,Ltd - Sales Manager
47 others named Xiaoyang Qian are on LinkedIn
See others named Xiaoyang Qian