Skip to content

Update code coverage analysis #8543

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
adityapatwardhan merged 4 commits into from
Jan 8, 2019
Merged

Update code coverage analysis #8543

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
db66b4a
Update CodeCoverageAnalysis.md
xtqqczze Dec 26, 2018
3afc7e4
Fix failing mdspell test
xtqqczze Dec 28, 2018
77bafc3
Fix to .spelling
xtqqczze Dec 28, 2018
d12f498
Clean markup
xtqqczze Dec 29, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .spelling
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -378,6 +378,7 @@ metadata
miaromero
microsoft
microsoft.com
microsoft.management.infrastructure.cimcmdlets
microsoft.management.infrastructure.native
microsoft.powershell.archive
microsoft.powershell.commands.diagnostics
Expand All @@ -390,6 +391,7 @@ microsoft.powershell.coreclr.eventing
microsoft.powershell.diagnostics
microsoft.powershell.localaccounts
microsoft.powershell.management
microsoft.powershell.markdownrender
microsoft.powershell.psreadline
microsoft.powershell.security
microsoft.powershell.utility
Expand Down Expand Up @@ -812,6 +814,8 @@ yurko7
zhenggu
- docs/debugging/README.md
corehost
- docs/testing-guidelines/CodeCoverageAnalysis.md
de5f69c
- docs/testing-guidelines/TestRoadmap.md
_no_
- docs/testing-guidelines/WritingPesterTests.md
Expand Down
72 changes: 21 additions & 51 deletions docs/testing-guidelines/CodeCoverageAnalysis.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Code coverage analysis for commit [2ae5d07](https://codecov.io/gh/PowerShell/PowerShell/tree/c7b959bd6e5356fbbd395f22ba0c6cba49f354f6/src)
# Code coverage analysis for commit [de5f69c](https://codecov.io/gh/PowerShell/PowerShell/tree/de5f69cf942a85839c907f11a29cf9c09f9de8b4/src)

Code coverage runs are enabled on daily Windows builds for PowerShell Core 6.
The results of the latest build are available at: [CodeCov.io](https://codecov.io/gh/PowerShell/PowerShell)
Expand All @@ -8,41 +8,33 @@ The metrics used for selection of these hot spots were: # missing lines and like

## Coverage Status

The following table shows the status for the above commit, dated 06/18/2017
The following table shows the status for the above commit, dated 2018-11-28

| Assembly | Hit % |
| -------- |:-----:|
| Microsoft.PowerShell.Commands.Diagnostics | 58.01% |
| Microsoft.PowerShell.Commands.Management | 32.02% |
| Microsoft.PowerShell.Commands.Utility | 67.55% |
| Microsoft.PowerShell.ConsoleHost | 41.15% |
| Microsoft.PowerShell.CoreCLR.AssemblyLoadContext | 97.65% |
| Microsoft.PowerShell.CoreCLR.Eventing | 29.91% |
| Microsoft.PowerShell.LocalAccounts | 86.35% |
| Microsoft.PowerShell.PSReadLine | 10.18% |
| Microsoft.PowerShell.Security | 44.44% |
| Microsoft.WSMan.Management | 4.91% |
| System.Management.Automation | 50.42% |
| Microsoft.WSMan.Runtime/WSManSessionOption.cs | 100% |
| powershell/Program.cs | 100% |
| Microsoft.Management.Infrastructure.CimCmdlets | 48.18% |
| Microsoft.PowerShell.Commands.Diagnostics | 47.58% |
| Microsoft.PowerShell.Commands.Management | 61.06% |
| Microsoft.PowerShell.Commands.Utility | 70.76% |
| Microsoft.PowerShell.ConsoleHost | 46.39% |
| Microsoft.PowerShell.CoreCLR.Eventing | 37.84% |
| Microsoft.PowerShell.MarkdownRender | 70.68% |
| Microsoft.PowerShell.Security | 49.36% |
| Microsoft.WSMan.Management | 62.36% |
| System.Management.Automation | 63.35% |
| Microsoft.WSMan.Runtime/WSManSessionOption.cs | 100.00% |
| powershell/Program.cs | 100.00% |

## Hot Spots with missing coverage

### Microsoft.PowerShell.Commands.Management

- [ ] CDXML cmdlet coverage. It is 0% as CDXML is broken due to CoreCLR [issue](https://github.com/dotnet/corefx/issues/18877).
- [ ] Add tests for *-Computer cmdlets [#4146](https://github.com/PowerShell/PowerShell/issues/4146)
- [ ] Add tests for *-Service cmdlets [#4147](https://github.com/PowerShell/PowerShell/issues/4147)
- [ ] Add tests for *-Item cmdlets. Especially for literal paths and error cases. [#4148](https://github.com/PowerShell/PowerShell/issues/4148)
- [ ] Add tests for Get-Content -Tail. [#4150](https://github.com/PowerShell/PowerShell/issues/4150)
- [ ] Lots of resource strings not covered. Will probably get covered when coverage is added for error cases. [#4148](https://github.com/PowerShell/PowerShell/issues/4148)

### Microsoft.PowerShell.Commands.Utility

- [ ] Add tests for Trace-Command. Especially Trace-Command -Expression [#4151](https://github.com/PowerShell/PowerShell/issues/4151)
- [ ] Add tests for ConvertTo-XML serialization of PSObjects [#4152](https://github.com/PowerShell/PowerShell/issues/4152)
- [ ] Add tests for Debug-Runspace [#4153](https://github.com/PowerShell/PowerShell/issues/4153)
- [ ] Add tests for New-Object for ArgumentList, ComObject [#4154](https://github.com/PowerShell/PowerShell/issues/4154)

### Microsoft.PowerShell.ConsoleHost

Expand All @@ -52,15 +44,11 @@ The following table shows the status for the above commit, dated 06/18/2017

- [ ] Add tests for ETW events. [#4156](https://github.com/PowerShell/PowerShell/issues/4156)

### Microsoft.PowerShell.PSReadLine

- [ ] We need tests from PSReadline repo or ignore coverage data for this module. (This will be filtered out.)

### Microsoft.PowerShell.Security

- [ ] Add tests for *-Acl cmdlets. [4157] (https://github.com/PowerShell/PowerShell/issues/4157)
- [ ] Add tests for *-AuthenticodeSignature cmdlets. [4157] (https://github.com/PowerShell/PowerShell/issues/4157)
- [ ] Add coverage to various utility methods under src/Microsoft.PowerShell.Security/security/Utils.cs [4157] (https://github.com/PowerShell/PowerShell/issues/4157)
- [ ] Add tests for *-Acl cmdlets. [#4157](https://github.com/PowerShell/PowerShell/issues/4157)
- [ ] Add tests for *-AuthenticodeSignature cmdlets. [#4157](https://github.com/PowerShell/PowerShell/issues/4157)
- [ ] Add coverage to various utility methods under src/Microsoft.PowerShell.Security/security/Utils.cs [#4157](https://github.com/PowerShell/PowerShell/issues/4157)

### Microsoft.WSMan.Management

Expand All @@ -72,24 +60,14 @@ The following table shows the status for the above commit, dated 06/18/2017

#### CoreCLR

- [ ] Lots of non-windows code can be ifdef'ed out. Issue #[3565](https://github.com/PowerShell/PowerShell/issues/3565)

#### CIMSupport

- [ ] Missing coverage possibly due to: CoreCLR [issue](https://github.com/dotnet/corefx/issues/18877).
[4159](https://github.com/PowerShell/PowerShell/issues/4159)
- [ ] Lots of non-windows code can be ifdef'ed out. [#3565](https://github.com/PowerShell/PowerShell/issues/3565)

#### Engine

- [ ] Add tests for COM. [#4154](https://github.com/PowerShell/PowerShell/issues/4154)
- [ ] Add tests for Tab Completion of various types of input. [#4160](https://github.com/PowerShell/PowerShell/issues/4160)
- [ ] Add tests for Import-Module / Get-Module over PSRP and CIMSession. [#4161](https://github.com/PowerShell/PowerShell/issues/4161)
- [ ] Add tests for debugging PS Jobs.[#4153](https://github.com/PowerShell/PowerShell/issues/4153)
- [ ] Add test for -is, -isnot, -contains, -notcontains and -like operators.[#4162](https://github.com/PowerShell/PowerShell/issues/4162)
- [ ] Remove Snapin code from CommandDiscovery. Issue #[4118](https://github.com/PowerShell/PowerShell/issues/4118)
- [ ] Add tests for debugging PS Jobs. [#4153](https://github.com/PowerShell/PowerShell/issues/4153)
- [ ] Remove Snapin code from CommandDiscovery. [#4118](https://github.com/PowerShell/PowerShell/issues/4118)
- [ ] Add tests SessionStateItem, SessionStateContainer error cases, dynamic parameters. Coverage possibly added by *-Item, *-ChildItem error case tests. [#4148](https://github.com/PowerShell/PowerShell/issues/4148)
- [ ] Add tests for Get-Command -ShowCommandInfo [#4163](https://github.com/PowerShell/PowerShell/issues/4163)
- [ ] Add tests for Proxy Commands [#4164](https://github.com/PowerShell/PowerShell/issues/4164)
- [ ] Add more tests using PSCredential [#4165](https://github.com/PowerShell/PowerShell/issues/4165)

#### Remoting
Expand All @@ -101,17 +79,9 @@ The following table shows the status for the above commit, dated 06/18/2017
- [ ] Add tests for Connect/Disconnect session [#4166](https://github.com/PowerShell/PowerShell/issues/4166)
- [ ] Add more tests for Start-Job's various options [#4166](https://github.com/PowerShell/PowerShell/issues/4166)

#### HelpSystem

- [ ] Add tests for Alias help [#4167](https://github.com/PowerShell/PowerShell/issues/4167)
- [ ] Add tests for Class help [#4167](https://github.com/PowerShell/PowerShell/issues/4167)
- [ ] Add tests for SaveHelp [#4167](https://github.com/PowerShell/PowerShell/issues/4167)
- [ ] Add tests for HelpProviderWithCache [#4167](https://github.com/PowerShell/PowerShell/issues/4167)
- [ ] HelpProviderWithFullCache, potential dead code. [#4167](https://github.com/PowerShell/PowerShell/issues/4167)

#### Security

- [ ] Add more tests under various ExecutionPolicy modes. [4168](https://github.com/PowerShell/PowerShell/issues/4168)
- [ ] Add more tests under various ExecutionPolicy modes. [#4168](https://github.com/PowerShell/PowerShell/issues/4168)

#### Utils

Expand Down