Internal controls

How consistent is the quarterly control self-assessment?

A proposed protocol for comparing how different reviewers test the same control.

This research is general operational information, not legal, tax, accounting, employment, benefits, privacy, cybersecurity, insurance, or financial advice.

How consistent is the quarterly control self-assessment? evidence review illustration

Question and scope

This is a proposed research protocol, not a report of completed findings. It asks how consistent the quarterly control self-assessment is. The result would describe the test, not the reviewer. Keep the evidence with the record rather than in a separate log.

The protocol does not measure whether the control was necessary. It measures whether the test was applied the same way. Keep the evidence with the record rather than in a separate log. Update the template when the same question appears twice.

Population and unit of analysis

Define the population as control tests during a stated quarter. The unit is one test, with the control, the sample, the finding, and the reviewer recorded. Record the exception and the person who approved it. Record the date and the source so the next reviewer can repeat the check.

Link the test to the control so the same control is not counted twice. A control tested by two teams should be recorded per team. Review the first few notes together before the process expands. If the source is unclear, route the question instead of guessing.

Definitions and measures

Define agreement as two reviewers recording the same finding on the same sample. Define evidence as the source behind the finding. Update the template when the same question appears twice. Keep the boundary visible in the place where the work is assigned.

Report agreement and evidence separately. A finding without the source is not repeatable. If the source is unclear, route the question instead of guessing. Name the owner in the same line as the action.

Evidence standard

Use the test sheet and the transaction sample. A finding without the item reference is weak. The reviewer should be able to repeat the check. Ask whether a new reviewer could act on the record without a conversation.

Record the date and the reviewer. A later review may need to see what was checked. Keep the boundary visible in the place where the work is assigned. Test the rule on one real transaction before applying it to the run.

Sampling and collection

Use a census of the tests. If sampling is necessary, stratify by process area. A sample that excludes the exceptions will overstate agreement. Ask whether a new reviewer could act on the record without a conversation.

Pilot the classification on a few tests and compare the reviewers. Clarify how a partly met control is treated. Name the owner in the same line as the action. If the source is unclear, route the question instead of guessing.

Analysis and reporting

Report agreement and evidence by process area. Show the tests with the lowest agreement. Present the results as a description of the test, not a ranking of reviewers. Name the owner in the same line as the action.

Limits and sources of error

The reviewers may share a training session, which can inflate agreement. The sample may be chosen by the control owner, which can bias the result. Record the date and the source so the next reviewer can repeat the check. Use the same format for every handover so the next reader can scan it.

Review cadence

Repeat the review after a test change or at the same interval each quarter. Compare the same process areas. Assign the follow-up to the controller and set a date. Keep the boundary visible in the place where the work is assigned.

Useful internal handoffs

Sources