Back in September how the JIRA works changed. Now we can’t really know what’s going on with bugs and other problems in Second Life™ because most of us cannot read the JIRA. We cannot browse or search the JIRA to see if a problem we are encountering has been reported. So, we just report our problem.
Nor do we know if a problem is fixed. Unless the problem is something we experience almost daily and one Tuesday or Wednesday it suddenly starts working. For users the JIRA Change is a pain.
Various parts of the JIRA work different ways. Some projects are open and anyone can read and comment on the items filed in those projects. Others are closed, like BUG, and people can only read and comment on the items they file and only until they are triaged. Only a few can read most of the JIRA projects. You can read my initial announcement here: Oh CRAP! JIRA Change (Sept 7, 2012).
Darien Caldwell started reporting SL JIRA’s in the SLUniverse forum so they would be readable by anyone. There we can comment on and search for JIRA’s. But, searching is not all that handy on forums. Also, using Google to search the forum has disadvantages.
Fortunately the SLUniverse forum uses tags and we can search by or with a tag. That seems to show the last JIRA item update was November 11, 2012. From the chart above you can see that about 300 items are filed per month in the SL JIRA. That suggests the SLUniverse forum is missing about 600 JIRA’s. So, the JIRA’s at SLUniverse do not provide a good substitute for a real JIRA search.
I’ve always thought getting people to double file a JIRA (file in the SL JIRA and then again at SLUniverse) was an improbable task… noble but unlikely to work. Far too many people using Second Life are unaware of the SL blogosphere and related forums. Some significant number of users are even unaware of the SL forum.
The Firestorm JIRA is another open JIRA where problems are reported. They tend to be oriented to the Firestorm and Phoenix viewers. But, some are SL related. Whatever, the number of bugs reported there is about half of what we see in the SL JIRA.
So, we simply don’t have a good alternative to the SL JIRA.
We are now 6 months down the road. The Lindens said they would reconsider the JIRA down the road. None were clear about when and probably none knew/know when a ‘reconsideration’ might be made, if that has not already been done.
I suspect the way things go is a ‘reconsideration’ would happen sooner if there were problems… apparent problems… with pain on the Linden side increasing the priority. Also, stats would tell the Lab’s management whether things were working. The chart above looks pretty good.
We can see most of the 305 items filed have been handled. All but 71 items have been handled as I write this. Also, some number of these items are duplicates. While many have been concerned about duplicates over loading the system I think it obvious that is not going to happen. Dealing with the 10 or so items filed per day is no big deal. Even if we take out weekends, that is still just 15 or so per day. Not exactly an overwhelming flood.
Plus duplicates can be marked handled pretty quickly. Say one does get 30 about 1 problem and 40 about another problem in a week. Those 2 problems would be entered and 68 items would be marked handled and closed. Hey, that is a support team that is really cranking through them…
It isn’t that bad, statistically at least. I am sure management knows that numbers game. Plus these public bug reports are taken into a private section of the JIRA known as MAINT. Those 70 reports in the BUG project would condense into 2 reports in the MAINT project. Performance would likely be measured on MAINT by management.
If you are following STORM-1716 (the Mesh Deformer item), you can see all the problems happening that the Lindens hoped to reduce. That JIRA thread has turned into a huge JIRA item that no one reads. Now complaints and ideas are repeating as new people fail to read and inform their selves before commenting or complaining.
Even those of us that follow the thread are burning out on it. So, it is obvious 1716 is the infamous remaining poster child for why the JIRA changed. I can only imagine how depressing it would be to work with such a mess every day. Trying to get real information out of such items would be a huge time waster.
Pain on the user side is pretty much immeasurable. Nor can we measure the number of reports that are not filed because people are unhappy with the change. Nor could we measure how many were not filed for whatever reason before the change. So, there is no objective comparison point.
I doubt there is any way to decide how many reports were just noise and whether that has changed. But, I do think one can measure in a general way the number of on and off topic or helpful comments added to JIRA’s. Since only the original reporter of a problem can comment on it now, I suspect comments are much more on topic. There are also far fewer comments, meaning less to read and time spent reading JIRA reports is likely way down.
Looking at things from the Linden side of the JIRA, things probably look pretty good. Form our side it is a problem only now and then. I see the degradation in the service the JIRA can provide. But, there is no way to quantify that such that Linden management can evaluate it. It is just invisible to them.
So, I doubt we will see any change in the JIRA system.
There are Problems
From outside the Lab we can see problems but we cannot quantify them. I think these problems are contributing to a loss of users and certainly a loss of people willing to own regions.
Events have been having problems for some time now. I’ve covered Toysoldier’s problems and complaints regarding the event crashes and massive lag since September. See: New Lag Problem.
The Lindens are busy with their assigned problems and work. Getting their attention is difficult. All the indicators of problems have changed and become rather restricted. We have no way to signal how extensive the pain is on our side of the system. The Sudden Massive Lag is an excellent example.
If a problem does get the Lindens attention, we have no way to know that. So, if they think they have it fixed, there is no good feedback system between the two sides of the problem. So, on one side the Lindens are all Yay! I fixed it! And the user is all OMG! I’m dying over here! Help.
Yeah, a problem with a specific symptom was fixed. But, the user is still experiencing the same symptom. The time to communicate the problem and get the Lindens re-started on a search for the cause is time consuming on our part as we have to start over. Plus we have to get it by the triage people that may often think it is a duplicate of a resolved problem. And… it may be solved and the solution is winding its way through QA. But, none of that information is communicated.
From the user side it is horribly frustrating.
So, we have a problem, that for all practical purposes, is invisible to the Lindens. I have no doubt the JIRA Change has improved efficiency and working conditions for the Lab.
From my viewpoint JIRA Change has reduced user feedback and communication. It is another hidden-from-the-Lindens contributor the degradation of the user experience and a drag on player retention.
The sad part is there is no way to quantify the problem in an objective way. That means there is no way to resolve the problem or even convince the Linden management of the existence of the problem. So, I say that unless we have a perceptive person in management at the Lab, the JIRA Change will become permanent.
Even more likely to make this change permanent is there is no solution offered to solve the problems that originally precipitated the JIRA Change.