My 2021 calendar year review

I haven’t written any reviews for my years in the past. So this year I am writing a brief review for 2021, the year that just went by. Here is a list of things that happened in the year 2021.

  1. Year started with vaccinations starting worldwide and a sense of victory over COVID and hopefully we/all thought the COVID time was gone. Turned out challenges were far greater than initial victories in vaccine science & creation, namely – trials, approvals, supply chain, number of vaccinations applied worldwide, delivery, manufacturing and more – it turned out to be a worldwide exercise which ultimately ecosystem of vaccines was able to conquer. Vaccine delivery to people was outmatched by new infections initially although over time during the year vaccines became available and people readily got vaccinated leading to better outcomes. Scientists and all associated with vaccines brought down the vaccine creation and production cycle from 10 years in the past to approximately one year which in itself is an unmatched feat till now. Positive thing has been newer types of vaccines, collaboration in science across the world and the fact that the lockdowns or restrictions brought us closer to family members and network where the commute time got converted to time spent with family and network either digitally or in person. We could use the extra time to build better habits of reading and much more. It taught us to value small things and things that we have in a realistic manner rather than focus on other things.
  2. In the first quarter, I decided to move out of services to a technology product company which also supported me in forming my own private limited firm. Turned out to be a good journey of learning, exploration and working in a new area – “Customer Success”. It was an area which I had not been actively working on in the last 8-10 years but as the year progressed I could pick up with the company’s help and move ahead.
  3. Teaching wise I consolidated from teaching at 3-5 universities / colleges / platforms to only one university. I have been teaching at Nirma University now for 3+ years as a visiting faculty where I now have focus on subjects – Python & R programming, Artificial Intelligence & Machine Learning, BigData & Hadoop, Business Process Re-engineering and taking few other lectures in co-teach mode related to information systems, programming, operations & data science at institute of management. Support from both places in terms of good mentors and colleagues where I work resulted in good quality output throughout the year.
  4. I could write about 11 blog posts in the year which is approximately 1 per month in varied areas. Lot of my past / current students or colleagues either in teaching world or industry or people in my network have triggered many of these discussions or the thoughts have come to me while randomly analysing many of these things. Overall I am looking for my network’s suggestions on similar topics continuously.
  5. Later, in spite of COVID and all the problems around it, Ahmedabad University and UCSD helped us to complete our GEMBA in online mode. All credit to them for running a top class program and keeping the same level of high quality delivery so that the whole batch could finish the program on time. I got a chance to do a 4 week certification on digitization of supply chains from NITIE and got admission to BITS Pilani for MTech in Software Systems as well – so time well spent.
  6. Looking forward to the new year – I hope everyone gets to put COVID behind and have a happy new year where people can spend time with family and network in a positive way plus have a career / job / business / startup / teaching / research area / spend time in a way that suits them.

Email me: Neil@HarwaniSystems.in

Career switches – Perpetual query (Grass looks greener on the other side – reality check) – Part 1

Being a visiting faculty for the last few years, I hear this one question many times. Is my current role, industry and job something I can spend my career in, I am not sure whether I will make it here. With time spent in this one area & increasing age what happens to me in long term.

Here is what I tell them:

  1. Think of your career as climbing a 100 floor building. You can’t climb 100+ floors in a short period of time like Will Smith generally, he is more of an exception. The elevator is not available many times – you have to take the stairs and climb 5-10 floors per year and in 8 to 15 years you will be where you want. Patience & persistence is what is needed.
  2. Competition & stress is everywhere – marketing, engineering, medicine, human capital management, finance, operations, art, sciences, computer science, investing, government and more. There is no free lunch generally. Running away from something you like only because of competition is not always the right approach.
  3. Go step by step – changing your path mid way is ok if you realize you genuinely don’t want to do something that you are doing currently.
  4. Try and avoid crazy shortcuts, smart work is welcome but crazy short cuts generally land us into trouble. Optimization like finding a new shorter, smarter way of doing an old thing or inventing a new area is good too but an abrupt shortcut that you know is not really the right way is not preferable.
  5. Build your own niche, network and talk to people, get into habit of reading and writing, interact with people and learn things that you want to learn by short courses, certifications and so on. That tells you where the market is going and what you want to do.
  6. Grass is always greener on the other side – what we do looks tough and what others do looks easier, the common thinking many have. Marketing & sales feels finance is easier, finance feels human capital work is easier, engineering feels management is easier and so on. In reality to succeed you need to work hard / smart in all areas and statistically very few get things by pure luck like a lottery – if they get it, its good but generally for majority of us, it’s going to be your smart / hard work with experience that will get you to success.
  7. Be open to various types of roles and experiences across cultures in your initial 2-5 years of career as that will tell you what you really like and where you can excel / innovate / build / research and work.
  8. Create opportunities out of whatever limited resources you have. Internet is a great leveller, you can build opportunities where none exist. Use it to learn, interact, write and read or to experiment.
  9. Cultivate your interests and hobbies.
  10. I have seen people switching after significant experience from banking to information technology, information technology to management, information technology to various types of businesses / startups, operations to human capital management, engineering to management, routine 9 to 5 jobs to teaching, engineering to acting and so on. If you pay attention to people around you, you will see many examples like these.
  11. Just because you are different and others are not doing something you want / can / are doing does not mean you should stop – maybe they don’t understand you yet!!! Rather it could be the start of something that is better than many other current models – that’s how many of the best things have started sometimes.

Email me: Neil@HarwaniSystems.in

Ways of learning in modern education – Part 1

  • Case studies
  • Field visits
  • Discussions
  • Practical
  • Simulations
  • Work integrated learning
  • Experiments
  • Guided learning
  • Experiential learning
  • Group assignments
  • Individual assignments
  • Quizzes
  • Critical analysis of news and articles
  • Case writing
  • Workshops
  • Paper / article / research writing
  • Whitepaper writing
  • Research / teaching assistantships
  • Thesis
  • Industry projects & reports driven by students
  • Internships
  • Survey and analysis of market data
  • Market research
  • Competitive events between institutions
  • Participating in standards / products / service creation
  • Industry and academic collaboration at faculty level
  • Games
  • Social experiments

Email me: Neil@HarwaniSystems.in

The other perspective – Social Media – Part 1

Have you realized below points when you don’t find people interested in your social media posts and activities? Its not always lack of interest or dislike that causes someone to be un-interested in your posts.

  • Is your post showing up on their activity feed or wall?
  • Are your interests and likes similar?
  • Does the other person have time for social media?
  • Is the other person active on social media? Is s/he searching for things completely different from you?
  • All social media runs on algorithms, optimizations and matching – is the algorithm correctly able to decipher where your & other person’s interests are?
  • Many people have profiles which are not exactly what they really are – either for interest of their privacy or other reasons causing more mis-match to happen
  • We get to see more and more of what we tend to like and follow, post and so on which may not be exactly in agreement with your network
  • Mathematically the permutations & combinations for even a network of 1,000 people connected to one person with 10s of likes and posts / activities per person builds such a vast set of events which is not humanely possible to track for one person
  • Probability of we seeing something that other person in our network wants us to see is very low
  • Before we judge why people have not been in touch with us, do realize some of the points above. Larger your social network in terms of physical world & virtual world – lower the chances of you observing activities, posts, likes and more from individuals in your network that they want you to see unless the matching algorithms are intuitive
  • These are some of the reasons why we keep seeing warnings about why we should not be judgemental about things on social media
  • Email me: Neil@HarwaniSystems.in

Information Technology culture across company categories – Part 1

Products:

  • High on collaboration
  • Cross department deliverables
  • Focus on specific areas like products, goals and such
  • They typically build their own strategy
  • Various sub-cultures like entrepreneurial, open source, hybrid and proprietary may exist within this
  • Controlled offerings for customers
  • Innovation & creativity is valued highly
  • R&D is important here
  • Flexibility in terms of what employees can do beyond the organization
  • Flat or semi-structured hierarchies mostly
  • Inventing a new category, offering, product, culture is possible here

Services:

  • No set boundaries on technologies, products & frameworks at times
  • Customer, partner & product ecosystems more or less drive the strategy & evolution
  • Standardization of delivery & facilities for employees
  • Silos & compartments within company by design and reason
  • Hierarchical & matrix way of reporting and work with management
  • Typically fixed set of roles & responsibilities for employees
  • Process plays an important role here

Startups & mid-sized companies:

  • No set hierarchy for interactions in the company – flat or semi-structured hierarchy
  • Focus on cutting edge domains and technologies at times
  • Evolves & builds strategy with the market & customers – Flexible in this aspect
  • Multi-tasking roles & responsibilities with potentially high growth and learning or relatively quick failure

Technology work in Non Technology product companies:

  • Focus on implementations of full projects & vendor, partner, product offerings mapped to business outcomes
  • Co-ordination with stakeholders within and outside the organization plays an important role here
  • Maintenance & support, evaluation of products & technologies, return on investment takes up a large amount of time

#culture

Email me: Neil@HarwaniSystems.in

PhD/FPM/EFPM, PGDM, MBA, MSc, MTech – “The Crystal Maze”​ demystified – Part 1

Here is my attempt to demystify – “The Crystal Maze” of Indian Master’s degree / PGDM / EPGDM / MBA / Executive MBA & PhD / FPM / EFPM. “The Crystal Maze” was a TV series as described here: https://en.wikipedia.org/wiki/The_Crystal_Maze – the programme focused on teams of contestants, a mixed group of men and women, attempting a range of challenges to earn time required to help them complete one final challenge, which if completed successfully earns them a prize. – From Wikipedia page of the topic.

Many students have questions around PGDM / EPGDM / MBA / MTech / PhD / FPM / EFPM and similar depending on their aims. Here are some notes for the questions that will drive you towards the answers:

  1. Where do you go for checking validity of PGDM / EPGDM in Full Time / Part Time / Online / Distance Learning mode – AICTE, UGC Distance Education Bureau websites
  2. Where do you go to check if your PGDM is equivalent to a standard MBA – AIU website
  3. Where do you go to check if your FPM / EFPM is equivalent to a PhD – AIU website
  4. Where do you go to check validity of degrees from central universities / autonomous universities & institutions of eminence – UGC, AICTE, AIU & MHRD websites
  5. Where do you check rankings of universities & institutes in India – NIRF
  6. How do you do a PhD if your PGDM is not equivalent to MBA – Either go to IIMs, IITs, Government institutions & universities which are autonomous / institutions of eminence or universities in the advanced economies
  7. What are the accreditations you should be checking – NAAC & NBA
  8. What are the foreign accreditations that Indian institutes & universities participate in – QS world rankings, Times Higher Education rankings, there are more as well
  9. What is triple crown – AACSB, AMBA, EQUIS – These are three accreditations which if a college / university / institute has they are called triple crown accredited

List of websites referred above:

  1. UGC – https://www.ugc.ac.in/
  2. MHRD – https://www.education.gov.in/en
  3. AICTE – https://www.aicte-india.org/
  4. AIU – https://www.aiu.ac.in/
  5. Triple crown – https://en.wikipedia.org/wiki/Triple_accreditation
  6. NIRF – https://www.nirfindia.org/Home
  7. NAAC – http://www.naac.gov.in/
  8. NBA – https://www.nbaind.org/
  9. QS world rankings – https://www.topuniversities.com/
  10. UGC DEB – https://deb.ugc.ac.in/
  11. Times Higher Education Rankings – https://www.timeshighereducation.com/world-university-rankings

Email me: Neil@HarwaniSystems.in

Word Cloud of my twenty years

I started work by programming few websites around the year 2000 approximately. Since then on and off depending on my role or work I have been programming, doing business analysis, building solutions and recently in last few years have been working in education & customer success.

Below is a word cloud which summarizes my experience and learnings, I hope you find it useful. I will be updating it regularly every few months. This is version 0.1 and needs many more updates which will come iteratively

Email me at: Neil@HarwaniSystems.in

DevOps in Networked & Technology infused world

My original article below, co-authored with Prof. Nityesh Bhatt. An abridged & modified version of this was published in a leading magazine.

Advice to youngsters, be your own publishing house – you have Amazon, LinkedIn, your own blog & website, multiple other good platforms, peer reviewed open access & top journals, don’t depend on others for publishing your work.  Message, context, grammar & meaning may at times be lost when we publish via third party systems.

Authors: Prof. Nityesh Bhatt & Neil Harwani (Visiting Faculty) – Institute of Management, Nirma University, Ahmedabad 

Date: 18th June 2021 

What is DevOps?

  • We are in a world that is providing services via eBanking, eHealth, eGovernment, eCommerce and many other electronic interfaces and systems. Things are getting digitized at a rapid pace. On one side, the common man uses these digital services and requires changes to meet their dynamic requirements for their daily work with software and technology companies managing these systems. But there’s another angle to all these electronic systems which is the developer community. 
  • Developer community & software project management evolved from the past by using concepts of waterfall in software development lifecycle, pair programming, iterative development and so on over the last few years and decades. Various programming styles like structured & object oriented evolved along with these methods. 
  • Overtime, these older methodologies became inefficient at delivering complex, time bound and customer outcome oriented products that changed over the course of time during development due to changing market needs. With this came AGILE & DevOps over the last few years. 
  • AGILE is a methodology where product specifications evolve over time and development happens in small 1 to 2 week sprints, customers are shown demos at the end of each sprint and sometimes everyday. AGILE gives developers, product owners and management a flexible approach to build software products which can evolve over time and are aligned to customer needs with course corrections possible at any point of time during project lifecycle. Primary keywords that are used in AGILE are: Scrum masters, Developers, Product owner, Sprints and so on.  
  • Overtime, limitations of AGILE were observed and then DevOps was created to improve the culture, deliverables and duration for project / product delivery. 
  • Requirements for collaboration & efficiency for geographically distributed teams became a necessity due to big improvements in network technology. This led to DevOps and rapid delivery becoming the norm of many software development projects.
  • Over the last 10 to 15 years, traditional software development with Waterfall methodology has rapidly moved to AGILE, iterative and hybrid AGILE software development methodologies. 
  • This shift was necessitated due to a large number of failures in software projects, cost overruns, customers not getting the product they want and such problems. 
  • AGILE has brought with it it’s own challenges in terms of weekly or two-weekly demos & deliveries. 
  • Developers can no longer wait for the operations team to ready the environment in a few days and weeks, they need continuous delivery, continuous testing, weekly demos, light weight processes for design, development, testing, documentation, packaging & release – all in a cloud environment at times. 
  • DevOps is a methodology where we combine Software Development & Operations and create a seamless methodology which works well in conjunction with AGILE software processes. Development team takes responsibility both for development as well as operations which significantly increases the throughput.
  • DevOps spans across Coding, Building, Testing, Packaging, Releasing, Configuring, Monitoring with cross-functional teams working on all these areas 
  • Timeline for Agile practices is given here at Agile Alliance: https://www.agilealliance.org/agile101/practices-timeline/
  • Timeline for DevOps as given on TechTarget.com: https://whatis.techtarget.com/reference/The-history-of-DevOps-A-visual-timeline 
  • Importance of DevOps to developers: https://www.statista.com/statistics/1127211/devops-importance-to-scaling-software-development/ 

UseCases for DevOps and rapid, customer focussed, sprint based deliveries: 

  • Smart cars – Car apps and navigation need rapid upgrades & security patches
  • Banking & Financial industry applications – Loan & Insurance processes regularly change which necessitate DevOps usage 
  • Smart electronics – Application philosophies from over the air to satellite to over the top to hybrid over the top with ecosystem apps change over few years and decades. Applications using them and their billing / user interfaces regularly get updated. 
  • Mobile phone applications – Every few months there are updates to operating systems, applications and overall ecosystem for regulatory, security & privacy reasons 
  • Digital manufacturing & 3D manufacturing require changes in assembly & production lines to cater to large numbers of products – Wide variety of products now need to be made from automated assembly lines & 3D printers. These need reprogramming at regular intervals
  • NBFCs – They have changes especially in micro-credit market in terms of coverage, limits and which segment to cater to 
  • Online education – From pre-pandemic to post-pandemic there has been change in acceptance, delivery & ecosystem of education. Online education is now acceptable for large parts of the population as well as universities & institutes. Quick changes in courses, delivery & methodologies can be facilitated by projects undertaken via AGILE & DevOps thinking. 

Why DevOps in Agile, Cloud, Analytics and 5G world?

DevOps is necessitated due to following reasons:

  • Cloud environment – Availability & need of virtual instances which can be scaled up and scaled down in seconds / minutes to meet varying demands of customers from different domains
  • Dynamic internet, cloud, analytics & 5G driven world where things are getting streamed, changes & integrations are common place
  • Due to the dynamic nature of the business environment, changes need to be deployed quickly. This is where AGILE & DevOps comes into play for rapid releases on bi-weekly or monthly basis.
  • Today, new application upgrades in Telecom, Analytics, Cloud, Manufacturing, Cars are deployed on a monthly basis at times. They necessitate a faster, relatively failure proof system of development, testing & release management.
  • Containerization and orchestration of containers in the cloud ecosystem provides these options and this in turn allows us to enable DevOps work at speed.
  • Requirements & design are discussed over calls and stored in tools like JIRA with development happening in DevOps way via containers. This in conjunction with weekly or bi-weekly demos & meetings allow regular course corrections.
  • Developers can’t wait for multiple team members to setup their environment or applications. Containerized environments and build tools with CI/CD pipelines allow them to do all this seamlessly.
  • Same concept applies to all the network upgrades in the 5G world, applications over networks, software defined radios / networks and so on. These necessitate rapid development infused with seamless operations for managing environments. 

https://assets.kpmg/content/dam/kpmg/be/pdf/2019/11/agile-transformation.pdf – As per the article from KPMG: “Agile Transformation From Agile experiments to operating model transformation: How do you compare to others?”, main drivers for Agile which in turn percolate to DevOps too:

  • Faster delivery for changing customer needs
  • Flexibility
  • IT & Business alignment 
  • Digital agenda goals attainment
  • Customer satisfaction 

Technology infused world 

  • We live in a technology infused world where rapid changes happen around us 
  • Every few years network technology changes, examples: 2G to 3G to 4G to 5G, Changes in app & billing ecosystem, Security updates, Software defined networks, Software defined storage, In-prem to cloud to hybrid cloud
  • Similar changes happen in navigation devices, mobile apps, smart cars, banking apps, NBFCs and such 
  • DevOps & Agile facilitate rapid development & deployment enabling businesses to achieve their goals in terms of upgrades and features in an environment that is contained, controlled and process driven with clear responsibilities and roles
  • Earlier in Waterfall compared to AGILE & DevOps now, there were no single set of atomic responsibilities for developers or product owners / managers. With introduction of these two philosophies, ownership and overall structure of technology products and their maintenance cycle (full life cycle) have seen quantum shift in terms of thinking 

DevOps, DevSecOps and MLOps

  • DevOps – Combines Development & Operations
  • DevSecOps – Combines Development, Security & Operations 
  • MLOps – Combines Machine Learning pipelines & Operations to productionize it in the same way as is done in DevOps 
  • Lot of innovation in terms of processes and tools is happening in the DevOps world especially around security, testing & continuous integration / deployment 
  • Multiple integrations for various aspects of DevOps span across products & tools in client enterprise ecosystem enabling most if not all technical & functional aspects of project / product delivery / customer needs to function in a quick and efficient manner 
  • Improvements in both AGILE like Scaled Agile & in DevOps like MLOps have been happening over the last few years in conjunction with all the improvements and new launches in Cloud ecosystem 
  • For development teams, initial learning curve of DevOps & AGILE could be steep but as they get settled into these newer ways of working, processes & systems around these concepts provide a cover which customers like, developers enjoy, business owners prefer and overall management teams get better outcomes from 

Popular tools, frameworks, products, toolchains & options:

  • Docker – Container environment 
  • Kubernetes – Orchestration system for containers
  • JIRA – AGILE / DevOps process tool 
  • Ansible, Terraform – Automation related 
  • Git – Source code repository
  • Jenkins – Continuous integration / Continuous deployment related 
  • Splunk – Data platform 
  • Bamboo – Continuous integration / Continuous deployment related 
  • Automated security, performance & testing tools / products – Katalon 
  • ELK – Search and analytics engine
  • Utilities like MAVEN, Gradle and such 
  • Monitoring tools like Nagios, NewRelic and such 
  • AWS, Azure & GCP – Cloud

References:

Email me: Neil@TechAndTrain.com

Reasons to adopt AGILE & DevOps

DevOps:

  • Developers need environments to be readied, recycled, shared, rebuilt in short period of time with least amount of lost time, control and additional jumps
  • Fused teams of developers, system admins where responsibilities are more or less completed via multi-tasking & multi-skilling by each member

AGILE:

  • Early feedback for product owners, developers & testers
  • Continuous feedback / demo driven development
  • Required documentation (Not less not more) via specialized tools
  • 1 to 4 week sprints giving out tangible outputs that can be demoed
  • Course corrections possible in the middle of the project / product life cycle

Tools / products / technologies for AGILE & DevOps:

  • JIRA and similar
  • Jenkins and similar
  • Containers, Kubernetes and similar
  • Git and similar
  • Cloud ecosystems
  • Ansible, Terraform and similar automation
  • Video conferencing tools
  • Monitoring & log products
  • Testing tools
  • Ticketing & Chaos engineering tools
  • Reporting tools
  • And more

References: Google Search, https://victorops.com/ 🙂

Reach me at: Neil@TechAndTrain.com

Four waves of Artificial Intelligence & Machine Learning

While teaching students in two different courses (AIML & “Data Science and Analysis”), there was a requirement to categorize historical AI & ML along with it’s interface with Data Science.

To start: AI is the superset, ML is a subset of AI, Neural Networks (Deep Learning) are specialized subsets of ML.

Below is a categorization of AIML across four waves and it’s interface with Data Science:

Wave 1:

Concepts: Traditional topics like state space search, heuristics, knowledge representation, expert systems, fuzzy logic, problem solving languages and such.

UseCases: Think a small basic robot moving through your home and taking decisions on avoiding obstacles.

Wave 2:

Concepts: Standard algorithms built on top of Regression, Statistics, Algebra, Probability, Calculus and such – Classification, Decision Trees, Association Mining, Clustering, Ensemble methods, Random Forest, SVM and so on. NLP, Computer vision, scanning solutions, advanced search and such areas also evolved here in parallel or with the help of these algorithms.

UseCases: Spam detection, Decision making, Co-related variables related predictions, Prescriptive Analytics and so on.

Wave 3:

Concepts: Replicating human / animal brain. Neural Networks. Storing and managing very large amount of data (structured & un-structured)

UseCases: BigData, Self driving cars, Image recognition, Complex reasoning, Medical diagnosis, Chat bots, Personal assistants, potentially unlimited usecases interfacing with all usecases across AIML & Data Science.

Wave 4:

Concepts & UseCases: Explanability, Interpretability – Understanding the complexity of artificial intelligence & machine learning models. UI & Low code driven AIML (Neural Networks), one shot learning, hardware optimized AIML. Deep Learning. BERT and newer context driven algorithms also are in this area, Natural Language Generation is another area here.

Where does Data Science interface with AIML:

  • Non structured data analysis
  • Natural language generation
  • Sentiment analysis
  • Use of standard algorithms to analyse structured data
  • Building insights & making predictions / prescriptions and so on

Email me: Neil@TechAndTrain.com

Ideas on Innovation around Software. We Thrive On Ideas. We are Learner Centered, Open Source & Digital Focused.