Validation Overview

Info

Full Data Asset Identifier
titanic/default/Titanic
Expectation Suite Name
BasicDatasetProfiler
Great Expectations Version
0.8.3+4.ge87e958c
Run ID
test_run_id_12345
Validation Succeeded
False

Batch Kwargs

engine
python
partition_id
Titanic
path
/private/var/folders/8_/yrr889196455tj9104lt6q900000gn/T/pytest-of-james/pytest-24/project_dir2/project_path/data/titanic/Titanic.csv
sep
None

Statistics

Evaluated Expectations
51
Successful Expectations
43
Unsuccessful Expectations
8
Success Percent
≈84.31%

Table-Level Expectations

Status Expectation Observed Value
Must have more than 0 rows.
1,313
This table should have a list of columns in a specific order, but that order is not specified.
[u'Unnamed: 0', u'Name', u'PClass', u'Age', u'Sex', u'Survived', u'SexCode']

Unnamed: 0

Status Expectation Observed Value
value types must belong to this set: BIGINT BYTEINT DECIMAL INT INTEGER IntegerType LongType SMALLINT TINYINT int.
int64
may have any number of unique values.
1,313
may have any fraction of unique values.
1
values must not be null, at least 50 % of the time.
100% not null
values must belong to this set: [ ].

1,313 unexpected values found. 100% of 1,313 total rows.
Unexpected Value Count
1
1
2
1
3
1
4
1
5
1
6
1
7
1
8
1
9
1
10
1
11
1
12
1
13
1
14
1
15
1
16
1
17
1
18
1
19
1
20
1
100% unexpected
values must be unique.
0% unexpected

Name

Status Expectation Observed Value
value types must belong to this set: CHAR StringType TEXT VARCHAR str string.
0% unexpected
may have any number of unique values.
1,310
may have any fraction of unique values.
≈0.9977151561
values must not be null, at least 50 % of the time.
100% not null
values must belong to this set: [ ].

1,313 unexpected values found. 100% of 1,313 total rows.
Unexpected Value Count
Carlsson, Mr Frans Olof
2
Connolly, Miss Kate
2
Kelly, Mr James
2
Carter, Rev Ernest Courtenay
1
Compton, Miss Sara Rebecca
1
Drew, Mr James Vivian
1
Duran y More, Miss Asuncion
1
Eustis, Miss Elizabeth Mussey
1
Hee, Mr Ling
1
Hegarty, Miss Nora
1
Herman, Miss Alice
1
Kenyon, Mr Frederick R
1
Louch, Mrs Charles Alexander (Alice Adelaide)
1
Markim, Mr Johann
1
Murphy, Miss Katherine
1
Myles, Mr Thomas Francis
1
Panula, Mrs John
1
Peacock, Miss Treasteall
1
Tannous, Mr Thomas
1
Veale, Mr James
1
100% unexpected
values must not match this regular expression: ^\s+|\s+$.

3 unexpected values found. ≈0.2285% of 1,313 total rows.
Unexpected Value Count
Barber, Ms
1
Daly, Mr Peter Denis
1
Geiger, Miss Emily
1
≈0.22848% unexpected

PClass

Status Expectation Observed Value
value types must belong to this set: CHAR StringType TEXT VARCHAR str string.
0% unexpected
may have any number of unique values.
4
may have any fraction of unique values.
≈0.003046458492
values must not be null, at least 50 % of the time.
100% not null
values must belong to this set: [ ].

1,313 unexpected values found. 100% of 1,313 total rows.
Unexpected Value Count
3rd
711
1st
322
2nd
279
*
1
100% unexpected
values must not match this regular expression: ^\s+|\s+$.
0% unexpected
distinct values must belong to a set, but that set is not specified.
[u'*', u'1st', u'2nd', u'3rd']

Age

Status Expectation Observed Value
value types must belong to this set: DOUBLE_PRECISION DoubleType FLOAT FLOAT4 FLOAT8 FloatType NUMERIC float.
float64
may have any number of unique values.
75
may have any fraction of unique values.
≈0.09920634921
values must not be null, at least 50 % of the time.
≈57.578% not null
values must belong to this set: [ ].

756 unexpected values found. ≈57.58% of 1,313 total rows.
Unexpected Value Count
22.0
35
21.0
31
30.0
31
18.0
30
36.0
29
24.0
27
26.0
27
27.0
24
28.0
24
19.0
23
20.0
23
23.0
23
25.0
23
32.0
22
45.0
20
29.0
15
31.0
14
33.0
14
35.0
14
39.0
14
≈57.578% unexpected
minimum value may have any numerical value.
0.17
maximum value may have any numerical value.
71
mean may have any numerical value.
≈30.39798942
median may have any numerical value.
28
expect_column_quantile_values_to_be_between(**{u'column': u'Age', u'quantile_ranges': {u'value_ranges': [[None, None], [None, None], [None, None], [None, None], [None, None]], u'quantiles': [0.05, 0.25, 0.5, 0.75, 0.95]}, u'result_format': u'SUMMARY'})
{u'quantiles': [0.05, 0.25, 0.5, 0.75, 0.95], u'values': [6.0, 21.0, 28.0, 39.0, 57.0]}
Column can match any distribution.

Sex

Status Expectation Observed Value
value types must belong to this set: CHAR StringType TEXT VARCHAR str string.
0% unexpected
may have any number of unique values.
2
may have any fraction of unique values.
≈0.001523229246
values must not be null, at least 50 % of the time.
100% not null
values must belong to this set: [ ].

1,313 unexpected values found. 100% of 1,313 total rows.
Unexpected Value Count
male
851
female
462
100% unexpected
values must not match this regular expression: ^\s+|\s+$.
0% unexpected
distinct values must belong to a set, but that set is not specified.
[u'female', u'male']

Survived

Status Expectation Observed Value
value types must belong to this set: BIGINT BYTEINT DECIMAL INT INTEGER IntegerType LongType SMALLINT TINYINT int.
int64
may have any number of unique values.
2
may have any fraction of unique values.
≈0.001523229246
values must not be null, at least 50 % of the time.
100% not null
values must belong to this set: [ ].

1,313 unexpected values found. 100% of 1,313 total rows.
Unexpected Value Count
null
863
1
450
100% unexpected
distinct values must belong to a set, but that set is not specified.
[0, 1]

SexCode

Status Expectation Observed Value
value types must belong to this set: BIGINT BYTEINT DECIMAL INT INTEGER IntegerType LongType SMALLINT TINYINT int.
int64
may have any number of unique values.
2
may have any fraction of unique values.
≈0.001523229246
values must not be null, at least 50 % of the time.
100% not null
values must belong to this set: [ ].

1,313 unexpected values found. 100% of 1,313 total rows.
Unexpected Value Count
null
851
1
462
100% unexpected
distinct values must belong to a set, but that set is not specified.
[0, 1]

Documentation autogenerated using Great Expectations.

Documentation autogenerated using Great Expectations.