Clover TPC evolution

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Clover TPC evolution

vmassol
Administrator
Hi devs,

I’ve recomputed the global Clover TPC by excluding all tests from the result and found the following results:

* 2012-07-02: 62.21%
* 2016-12-20: 65.29% => +3.08%
* 2017-11-09: 68.59% => +3.3%
* 2018-04-03: 68.34% => -0.25%
* 2018-05-11: 68.77% => +0.43%

So:

* From mid 2012 to end of 2016 (4.5 years) => +3.08%
* From 2016 to 2017 (11 months, almost 1 year) => +3.3%
** Big increase compared to before where it took 4.5 years to get a similar results
* From 2017 to 2018 (6 months) => +0.18%
** We’re doing quite bad in 2018 so far.

My next step is to find out the biggest offenders by sorting the packages having lost the most TPC while having the most covered elements (a package with one class that goes from 80% to 50% is less important than a package with 10 classes going from 80% to 70%).

Thanks
-Vincent

Reply | Threaded
Open this post in threaded view
|

Re: Clover TPC evolution

Ecaterina Moraru (Valica)
Interesting analysis

Thanks,
Caty

On Tue, May 15, 2018 at 8:11 AM, Vincent Massol <[hidden email]> wrote:

> Hi devs,
>
> I’ve recomputed the global Clover TPC by excluding all tests from the
> result and found the following results:
>
> * 2012-07-02: 62.21%
> * 2016-12-20: 65.29% => +3.08%
> * 2017-11-09: 68.59% => +3.3%
> * 2018-04-03: 68.34% => -0.25%
> * 2018-05-11: 68.77% => +0.43%
>
> So:
>
> * From mid 2012 to end of 2016 (4.5 years) => +3.08%
> * From 2016 to 2017 (11 months, almost 1 year) => +3.3%
> ** Big increase compared to before where it took 4.5 years to get a
> similar results
> * From 2017 to 2018 (6 months) => +0.18%
> ** We’re doing quite bad in 2018 so far.
>
> My next step is to find out the biggest offenders by sorting the packages
> having lost the most TPC while having the most covered elements (a package
> with one class that goes from 80% to 50% is less important than a package
> with 10 classes going from 80% to 70%).
>
> Thanks
> -Vincent
>
>