After attending the STAR West 2017 conference this year, I wanted to take a little time to share some of my thoughts, takeaways and inspirations from the conference.
STAR West is a pretty large conference and it felt big, lots of people, lots of vendors and lots of sessions. Here are some of my thoughts and favorite moments of the conference.
Rise of the Machines: Can Artificial Intelligence Terminate Manual Testing?
When I sat down and got ready for the opening keynote I wasn't sure what to expect. Machine Learning and AI in the software and testing worlds are major buzz words right now, so I wasn't surprised to see them at the forefront of the conference. Largely uninformed and entirely skeptical I have been dismissing machine learning completely so I admit I cringe when I see talks about it and expect hype, fear and smoke and mirrors.
So when Tariq King hit the stage I was skeptical, however he opened with this montage of pretty much every sci-fi movie representation of artificial intelligence there is all nicely edited amd mixed with music. It was slick and polished, I sat thinking this is the big leagues of keynote speaking.
Tariq also brought forth a challenge to push testing forward through innovation. To paraphrase he stated that testing as an industry has in many ways been falling behind, he even has #bringbacktesting. This really resonated with me, ironically for some of the same reasons I resisted machine learning. It's just the latest thing that will be the death to testers.
What I particularly appreciated from the keynote was the recognition that there are differences between machines and humans and they each have benefits. This reconciles quite nicely with my views on automated testing.
Highlights
This was one of the most polished keynotes I've seen, I left with very high expectations for the rest of the conference.
automation is just the end product of a lot of testing
- tariq king#starwest #soGood— Brendan Connolly (@theBConnolly) October 4, 2017
automation is just the end product of a lot of testing
- tariq king#starwest #soGood— Brendan Connolly (@theBConnolly) October 4, 2017
Make Your Team Awesome—Yes, You Can!
I was very excited to get to hear Maaret Pyhäjärvi give the closing keynote. It was great, I'm not sure it was recorded but I would love to watch it a few more times just because there was so much good information and I could do a more in depth post on it. Maaret wove topics and her experiences at the conference into her keynote, so it felt fresh and authentic. I got swept up in just listening and couldn't take notes like I did with other talks. As the talk progressed there were a few times where the message was so clear and insightful I thought it Maaret was going to drop the mic and walk off stage, but the good stuff kept coming.
If I sound like a fan, I am but I cant tell you how many other people I heard on the way out of the conference talking about just how great this keynote was.
Highlights
Sitting in awe of @maaretp speaking the truth and just killing the closing keynote #starwest
— Brendan Connolly (@theBConnolly) October 5, 2017
I am my developers external imagination @maaretp #starwest
— Brendan Connolly (@theBConnolly) October 6, 2017
4 C's of being a tester @maaretp #starwest pic.twitter.com/1XXG8wPwPW
— Brendan Connolly (@theBConnolly) October 6, 2017
There were so many more...
AI For Test Automation
This session was a result of another speaker cancelling and Jason Arbon of AppDiff stepping up to fill in. I am so glad of that cancellation. As I mentioned earlier, I gave very little credence to AI and machine learning going in to this conference but I left this session extremely interested in machine learning. Jason was able to demonstrate some generic automated test cases working on applications that his bots had never seen before. While he was showing his teams work, this talk was by no means a vendor session. He was quick to explain how little actual code it takes to wire up a neural net, the real work is in training it. It was fascinating and his passion for the subject matter really shone thru. He also shared the site test.ai where I believe they will be making some of their supporting libraries so teams can try building their own neural nets for testing applications. I can't wait to check it out.
Highlights
People had to be kicked out of the @jarbon talk on ML #starwest #amazing passion makes such a difference
— Brendan Connolly (@theBConnolly) October 5, 2017
Get Involved Early: A Tester’s Experience with Requirements
I really enjoyed this experience report by Julie Lebo. Good requirements have been a challenge on many projects I have worked on. Her journey as a solo tester was really informative, she discussed going back to school to get her masters degree in computer science. I am interested in computer science but I have read mixed things about the value of masters level computer science considering it can often be very theoretical in nature. It was great to hear a tester talk about her thesis and the value it brought her as a tester.
Highlights
it can be in a spreadsheet it can be on a napkin, a requirement is a thing you need it to do
- @julielebo87 #starwest— Brendan Connolly (@theBConnolly) October 5, 2017
they want a choice not a choice box, beware of implementation drifting into requirements
— Brendan Connolly (@theBConnolly) October 5, 2017
without questions, there are just implemented assumptions@julielebo87 #starwest
— Brendan Connolly (@theBConnolly) October 5, 2017
Testing and DevOps: Organizations and Their Culture Must Change
The bar was set pretty high for the second keynote on day 1, but it was a very different type of talk. It felt like a successful experience report of a teams transition to DevOps. There was a nice focus on the need of philosophical changes for teams to transition to newer ways of doing things, focusing on DevOps being a extension of an Agile transition.
There some good stuff:
- including regression testing into current sprints instead of a release / hardening sprint
- enable testers involvement early and in a manufacturing sense allow them to Halt the line.
- include automation early as a collaborative effort to increase alignment
- the importance of test data
Unfortunately when time came to discuss how testers roles change in DevOps, the talk fell to the very expected topic of increasing technical skills of testers. It's not that I don't understand or recognize this shift, but I think testers have heard this before. I would have like to see more depth and insight here, there are some very highly functioning Agile / DevOps teams that value exploratory testers. I think the audience would have benefitted from hearing how those teams have changed.
Highlights
how are you going to fix our test data problems?
- @Bugman31 #STARWEST— Brendan Connolly (@theBConnolly) October 4, 2017
for change to be successful it has to be bottom up and top down or else someone is going to kill it@Bugman31 #STARWEST
— Brendan Connolly (@theBConnolly) October 4, 2017
Technical Track Sessions
Technical session can be tough, its tough to balance because the skill levels of the audience can be so broad. If any spike my interest I usually pick a backup session so I can walk out if I don't feel like I am getting anything out of the session. Happily though I didn't need any exit strategy for either of the technical sessions I attended.
Testing RESTful Webservices
Hillary Weaver Robb gave a nice overview testing web services with both tools and code. This is an area I work on quite a bit day to day but its nice to see how other people are doing things and see if there are things we could be doing better, etc. It was good stuff, and being in the crowd I could tell people we getting stuff they could take home to their teams.
Star West has this idea of Speaker Lunches where attendees can sit at certain speakers tables, it was a nice touch and I got a chance to chat with Hillary. She runs the Ministry of Testing group in Detroit and she totally hooked me up with a pin.
awesome picking up @ministryoftest swag at #starwest thanks @g33klady pic.twitter.com/2o7MQleEab
— Brendan Connolly (@theBConnolly) October 5, 2017
Say Goodbye to Flaky Selenium Tests
I wasn't sure about choosing this session, but I have a project coming up where I plan on using Appium and figured I'd give it a try. My current team doesn't have a dedicated and separate automation group, so it was interesting to see more enterprise approach to building out automation. It worked out well though, Craig Schwarzwald gave solid advice and what is basically a necessity for an enterprise groups supporting other teams really results in a solid and maintainable framework. I'm glad I stayed and I have things I can directly apply and also felt validated in some of my decisions, mostly around not allowing selenium implementation details to creep into actual test code.
Impressions
It was a good conference and I am glad I got to go, being held at DisneyLand was a nice touch as well.
A couple time slots I found it hard to find any sessions I found interesting and it wasn't always clear when or if there was time for Q&A during talks. I really thought the lunch with speakers idea was a real benefit for the attendees.
Unfortunately I missed Paul Merrill's talk on machine learning which I heard was very good. I'm hoping I can catch it through one of the webinars he hosts.
This happened, plus it was a great lunch conversation.
Lunch with @maaretp and @dpaulmerrill totally made my #STARWEST. They tolerated my fanboy excitement so nicely pic.twitter.com/TH3sKS1uen
— Brendan Connolly (@theBConnolly) October 4, 2017