Not really here, but Matthew just having
this was able to come up with this UI
that could take take those results both
on the entire test and by sub area and
come up with a way to like graphically
show that. So Matthew, can you talk, can
you talk a little bit about like what
this was like to set up your logic and
what you found when you were working on
this?I think this is the coolest thing.
It looks nice.
Uh, allergies.
Yeah, everything worked all after,
um, answering the questions mark
and yeah, at the passing.
All the queries um.
Once, once I saw the item ID's and
had to solve earlier, uh, I kind of
realized I could just break everything
down from the one field. So I wrote
the logic to group each response by
object and then roll that up into the
overall test score. Yeah, and I met that
into something that. Heart could read
so we could show the whole
test view self fairy view by
my side. I
was seeing that data line up
cleanly. Uh, the parting was right
and the charge almost killed themselves.
Yeah, it actually showed some pattern
when I tested it. Like, wonderful,
yeah. Which objectives were
consistently strong or weak?
Yeah. So that is
great news, Matthew. So this this is this
is this is excellent. This is just what I
was hoping that, you know, something like
this would be possible. I think another
tie in we might want to do is so
that we can display like the sub area
titles or the objectives names themselves
is that we would have to grab that.
Information from those JSON files which
is in a different part of our
solution, but still organized by test
code. It's because I'm thinking
like the way we display the objectives
like in the, UM, in the study guides,
like those exist in adjacent somewhere,
right?Yes, we
go through the competencies. Yes,
consider competencies. Competencies,
yeah. So we could pull that
into the the practice test TS
file. And make it
available for use. And then, and then
basically Matthew's logic could you know,
say, OK, I'm in, I'm in whatever. I'm in
test code 202 and I'm in sub area 1. So
go to that competencies file and pull out
the title of subarea 1 and display that
on the screen. So like, so we could say
something like, you know, sub area 1:
whatever. Algebra and then show the
little chart and then and that and that
shouldn't be too, too tricky to do
because we've got all of that data just
exists just in that just one additional
JSON file. But that doesn't matter,
right? We can use as many as we want to
wait. Yeah, you have two different
things. You have the domain, which may
just be domain one or has the title of,
you know, algebra. Then you have your.
Competencies, which is objectives, Oh,
oh, one. And then those titles are more
descriptive. So it's not it's a longer.
You know, it's like kind of the
description of ohh one if that's what I'm
talking about show. So it's it's it's
lengthy. It's not right. Those can be
lengthy. That's a good point. Yeah, so
we'll have to that's a good point. Those
can't be kind of be lengthy. That's
right. So we'll have to figure out like
what we want to display and like how many
words is too much words and. It will be a
conversation we'll have to have with like
ASD in the business, right? And say like,
you know, what do we want these to look
kind of slick and keep it at the sub area
level because there's not a lot of words?
Or if we do an objective by objective
breakdown, do we have to have the full
objective titles? Or can we just say
objective 1, objective 2, objective 3,
and then and then which might be a lot
nicer, right? And then encourage the user
to go click on the link and you know,
give me a link to the study guide. Case,
you know, if you if you scored poorly in
one area, you may want to go review the
review this objective and the study guide
and do some more studying or something
like that Anybody can do that yeah OK.
But I love I love the fact that this is
possible that just putting some logic in
place It's it's it's the kind of update
that this setup allows us to do right.
With some logic and all of a sudden we
can have this feature on every single
practice test. As they're
all set up very similarly that we'll have
to go through and see what an appropriate
design is going to be for the practice
tests that don't have any MCQ's or have a
mix of MCQS and Cris. Because we've got,
we've got all flavors, right. We have a
lot of them are MCQ only, some of them
are CRI only and some of them are a mix.
So you know, we'll need to. Need to have
a clear indication of what we want to
show each one of those cases.
But the fact that this is working the way
I was hoping it would work is wonderful
news. Matthew, thank you so much for
spending your time, like working on this
and getting the charts library into this
component and all the rest of it. Ohh.
And Diane, we, this is so funny too. We
followed your link into the Topaz
documentation there for the, you know,
for their charts. And yeah, behind the
scenes it is charts JS. This like that's
what they use. And then I think we've got
yeah so far yeah, because we clicked the
link and was looking at I just started
laughing. I was like ohh, OK, so that
makes sense now, now. Now it's like
all the pieces like tie in. So now, OK,
yeah, I get it. Um, so that's great. So
we have, I mean, Brian and Brian has used
this in the, you know, the work on the
HTML score reports that he did. So we
know that it's an acceptable Pearson
approved kind of tool to use and it's
pretty robust. There's, I mean, it's kind
of like a Google charts kind of thing.
There's like a lot that's there we can,
we can like look through the
documentation. See what kind of charts we
think look good and what's I think, UM,
we may also want to just do a Google
search for just like, you know, score
report or practice test and just like
look and see what other visuals are out
there that other companies have used
different kinds of exams and see if
there's any kind of like graphic, You
know, I mean like just kind of look
through some you because I don't know
what test results look like nowadays.
Like if I were to take the GRE. Where
else ads or something like that, I have
no idea what those look like. Might be
good to like go. We're trying to remember
it's because it's was kind of a long
right. It was kind of and it had the line
items for each objective or was sub area.
Let me I'll I'll grab one right now and
put it in the chat. I think I still know
where where they put those. Yeah, and
this one it's it's so simple. This see, I
love the simplicity yeah, because because
we know right, A lot of our users are
going to be on smaller devices.
And, and so I, yeah, there there's this
kind of their practice tests, at least
the one that delivered to us anyway is I
don't know, I think ours look better
personally, but there's, there's look a
little dated.
Yeah, but let me see. Um, ohh,
let me grab one now.
We've done, we've done some test ones
recently, right?So I'm
wondering if you click on like the pink
or the green, does that then open a more
detail of specifically which questions?
You know, we could, we could do that.
Yeah, yeah. Like they, yeah, yeah. We
just need to come up with a design that
we like and then and then build it out.
But I think we have an awful lot of
options. Yeah.
Um sorry I'm still looking for
this. Ohh scoreboard QC OK.
This one I think. Sorry, I'll share this
in the chat in just a second. Just want
to make sure I'm sharing the right file,
OK?
Ohh no that's not what I wanted to learn.
Ohh, my poor little computer. Here we go
again, because I'm running like two
programs at once now. It's um.
Really struggling. Um,
OK, here's one.
OK. So there's at least in some of the I
think, I think this can vary.
Project by project, I think we can um,
either report at the sub area level or
the objective level. I think that I think
it's umm, that's like a, an option.
Umm, how can I not put a PDF in here?
Oh, there we go.
So this is like this is the one I
just shared in the chat. This is
Foundations of reading.
And we do report, we we do provide data
at the objective level. So they build
like this table.
And they include the full length of the
objective in your right hand, right?
Those get kind of wordy.
And then like a total number of questions
per objective and then the percentage
that the user got correct.
But that's not yeah, I think it does, but
there's probably links that link
somewhere back to. So these links link to
that section of the practice test because
now that the user has its scored, this is
how they go back and like look at the
see how they did item by item and look
at the rationale. So if you click on
anywhere. These links it takes you to the
first item of that objective and then you
can click through and look at the rest of
them.
Yes. So we'll just have to we'll have to
play around with it a little bit and just
see, you know, how much data do we want
to provide? What do we want the UI to
look like? I like more chart heavy and
less text heavy if possible. I think
that's, you know, just a lot quicker to
glance at it looks a little bit slicker,
that kind of thing. But we can we can
see. But just just the fact that Matthew
has kind of proved for us now that this.
This is completely something that we can
do based on the current setup we have. We
can just add more logic to display the
user's performance data and whatever
however we kind of see fit. But it's all
it's it's it all works kind of the way
we wanted it to work. The all the data
is in place with the files. That we have
right now, we can just add logic to
display it. And so that's wonderful,
right? Because I, I guess I had in the
back of my mind that it would just be
awful if we had to go into like the 20
something, I'm sorry, the 200 Jason files
with the practice test data and like add
more stuff there. And this is on your
wish list when we started this project.
You know, to have, I know. Yeah, yeah,
yeah. Right. Yeah, yeah, yeah. That's why
I, well, I had built that other one
just just when I was when I was
teaching myself React. Yeah, that worked.
Like it's just kind of a similar setup,
but it just works differently. So it
doesn't, it doesn't really matter. Um,
but, but yeah, but we didn't have to, we
did not have to have this for the initial
launch, but we, we are going to have to
have this. We've got another round of,
oh, This is why. Rich, thank you for
reminding me our team meeting today, I
want to talk about this too. We've got
another round of practice tests for
Georgia coming up in Q1 next year that
we're going to have to create. Um, the
original plan, I don't know why, but the
original plan was to launch this next
round of practice tests using ITS and
have like a mix of practice tests on the
website. So some of them would be ours
and some of them would be ITS, but we're
no longer doing that. We're going to
build them too. And so what's gonna
happen is that right now, as you guys
know, all the exams. Um, have a
free practice test, so.
This next set of practice tests coming
online, it's basically going to be like a
a separate second form for some fields
that candidates can purchase if they want
to. So the current ones they'll keep
getting free with registration and these
new ones that are coming online will be
for sale only.
And so the good news is we'll we'll have
just figured out how to sell practice
tests, right? Because that that'll be
going live soon for this faculty sales
part. And so now what we'll have to do is
figure out a way for candidates to say,
OK, when you register, you'll get one for
free. But here's the second one with a
different set of questions that you can
purchase if you want to. And make
sure they have access to that one. But
because we've got we're going to have the
sales feature already built out by the
time we're working on that. I'm hoping
that it's not really that tricky at all.
We'll just have to be careful. We'll
probably have to tweak the logic that
provides the candidate the practice test
for free when they register. Just making
sure that just figure out how that logic.
Works and so that whatever we name the
ones that are fee based only, we don't
accidentally serve those up for free too.
And then, umm, and so rich, you were
saying that we asked the TMD crew to, to
kind of let us know when the, the files
were ready and when they were ready to
set up. And they, and they turned over
those exports just like they did when we
built the first set of practice tests,
however long ago. God, it was almost this
time last year, right? Just a little
started in January or February. Umm,
so I have, I have
that umm.
That. That program
that the Nest team wrote to convert the
its exports into our JSON files. They'll
probably need some massaging after that,
but it gets a lot of the heavy lifting
done. And so, Rich, could you remind me?
I don't know if you have it open, I
can go check too. I don't
remember what the schedule looked like
like when we were when CPS was supposed
to get started on these builds and when
they were ultimately going live.
Give me one second, I'll bring
up. I created a task for
this one, um.
OK, Yeah. So it's, it's going to
be two, two practice tests. Uh, one
practice test, uh, the Tesla based
assessment that's elementary education.
So it has 5 tablets and then
para pros the other 1. So it's
a standalone. So we have one standalone
that's actually pretty good just for
modeling. Um, so right
now I have tech working on
this, these builds, uh, 1211 so
tomorrow through January 5th.
Um, I can actually link, but the link
to the and what's the, what's the go
live on this one, right? Actually, if you
get the live, because what, what I would
like to do is not even start this
work until after the holiday. OK, but I'm
not sure how much that's going to come
or. Or like actually it's not entirely
true. Um, because I know we've kind of
already told the team that we can that we
can meet these dates. OK, so these are
these ones are going live February 16th.
Ohh, I'd so I think will be OK. I think
we'll be OK, OK um.
Yeah, OK. Especially if you have
a more automated process of building
the. The PT with
the sample items. Yeah.
And that's, that's absolutely hoping that
for sure. Yeah. So I think, I think
what we can do, Rich, is, um, well
or no, I think we can do this.
I think we can do this.
This 12/11 to 1/5 time,
let's tweak that and make,
um, and make some of
that my time to, to
get a process in place
for how to do the
automated conversion. OK, and then
and then. Um, let's
say like through, let's say through the
week of Christmas, like through the 20,
the 26th, because then Diane, you're back
the next week, right? You're, you're back
on the 29th, yes, OK.
Yeah, that's great. If you have a
process, just a little outline where the
links are, that should.
Yeah, because what I want to do is,
um, the tricky thing is it's a like
it's a.net app that they wrote.
So I so I'm just going to put a process
in place on how to now it's it's
completely like done in it's in it's
something that we can just run. We don't,
we don't have to. We like we take the
source files, put them in a certain
location, run this program and it spits
out the JSON. So I just want running
locally. I don't need it to run locally
on the machine then. But I, I think,
I think you will, I think we'll have to
install it. Yeah. And that's why I,
that's why I took a peek at it, went and
gave it to me. But I haven't had, I
haven't had a chance to go back at it. So
but, but my goal between now and then is
to come up with a process that tech can
just repeat. And there's probably going
to be an initial setup to set up your
machine so that you can. Run this app and
then going forward it should be, fingers
crossed, pretty simple.
But we found before that there was some
additional cleanup that we had to do.
Remember that because like the IT system
allowed for like spaces in the files name
if there were images and stuff like that
or like or like multiple periods like it
had like the its system allowed some
weird file naming stuff in our system
does not allow that.
So that needs to be part of the tech bill
too. It's going to be like, you know, run
the conversion and then basically do some
amount of cleanup. Hopefully it won't be
that bad, but it but you know, some
amount of cleanup And and if, if we do
have to rename some of those, umm, what
did we call those in the files
themselves? I. Resources
maybe, you know, if there was like an
audio clip or video clip or an image or I
think this really, yeah, basically it'll
be to some amount of cleanup will be to
clean up the the file names of the
resources themselves. If there were those
cases where we had multiple periods in
the file names or, or whatever, you know,
or the spaces or whatever other issues
they had. In there umm and then also to
fix the links to those resources in the
JSON. And so I, so
I know that's going to be part of the
cleanup. And then, um, I think, I think
what the checklist is going to be
something like, you know, run this tool,
do the cleanup. We
already know how to have these,
um. So that we can review
them locally as we're building them,
which is great, right? Because I would
want the, UM, I would want you or whoever
else was building these Diane and tech to
be able to like kind of like just click
through it and make sure things look as
expected before turning it over to PC.
But then for EPQC, we would need to,
um, get them into, I think into test.
Because then, then the PQC would have to
be like to do a purchase and then access
the practice test. Now we Brian D might
come up with a way from us where we can
access the practice test with like
without being, without them being
purchased or something like that. But so,
so basically this first one, we have to
figure out a process as well as actually
do the work.
And then the hope is by the time these go
live in February, we also have that kind
of updated, um, score reporting UI that
Matthew's working on now to get like, you
know, some amount of charts and figures
in place on that opening page and make it
look a little, a little nicer. Give
people a, you know, nice at a glance
overview of how they performed.
So we'll build another feature for this I
think too. Then we'll do make it a
feature. Absolutely include all that. OK,
Yes, Yep, absolutely. And Matthew, is
that what you did locally? Are you did
you or I guess it's OK if you haven't
created a feature yet. But yes, we should
have like, I don't know whether we call
it like. This test upgrade or something
like that, but but build um build a
feature branch for this work.
OK. Yeah. Can we base it off of
this year at 2306? I'm sorry, Matthew,
sorry. Well,
we've got this one and then we have
Matthews Good Ajira 2 for the you know, I
might, I might create an epic for us and
tie a number of these stories into the
epic because we've got this first goal
live here for February and we have the.
The score report which which we already
which Matthew has a JIRA for and then
we're also going to have a story to make
sure that we can sell these.
Um, and so, and so, and that's going to
have to come with a component for ESS,
right? Because the support team is going
to have to create purchase tables for the
database. OK, so, so I think,
I think I should make an epic for these
and then flesh out those other stories.
Uh, and so Diane, we should probably name
it after the epic.
That sounds good, yeah. But let me just
let me just create that.
Be really a practice test upgrade and
that's going to be sales of V2.
And score report, the score
report upgrade OK.
All right, so let's see for next
steps. Then when I am back next
week, I will um.
But let's have let's, I know it probably
in our, in our, in our meeting next week,
or at least let's discuss next week about
how to kind of brainstorm what we want or
what we would like to propose for a UI
for this, like what kind of charts, what
kind of, what kind of level of
information, um. You know, we, we can
just spend a meeting kind of Googling
around and looking at different pictures
and, and seeing like, what looks nice,
what doesn't look nice. Um, and then, and
then get some because I'd like to, I'd
like to sort of start there. Like
basically we were assigned to kind of
propose a UI for this. So, so let's do
that in our next meeting. Let's, let's do
a little bit of brainstorming. Figuring
out what we think looks the best and
then, um, getting Matthew a little bit of
time to build that and then in in the
interim, I'll I'll create the epic and,
and once this work is ready to put into
the feature branch, we'll get all that
created and put into place. Um, so yeah,
Rich, actually if you wanna just assign
me this task now if you're, if you're. If
you're done with it. Uh, yeah. OK, yeah,
I'll just add a pathway to the files that
Jen provided. I adjusted the schedule
too. So I've got a two-part schedule, one
for the practice test builds and the
other one for the related website
updates. Ohh, perfect. OK, good. Thank
you. Yep, that, that makes a lot of
sense. Yeah. Yeah, because we have to
think about that UI too. Like what? Like
what are these? What are these pages? You
know, currently we have information on
the website, of course, that tells
candidates, hey, there's a practice test
to get a free with Rich. But now that
it's some candidates have a V2, what does
that look like?
Yeah. So I have to think about that as
well. OK, Yeah, good. OK, very good.
All right, so this all makes sense to me.
Um, Matthew, thank you again for your
work on this. I when when you sent over
that that image, I was so happy that I
love seeing that kind of data right there
like that. It just this looks fantastic.
This is going to be great. I can just see
it now, you know, a user finishes the
test, they click get my results and boom,
they see little charts and graphs and
then they can. Still click through the
questions and all that's still in place,
but yeah, this is going to be wonderful.
Yeah, thanks. That means a lot.
Yeah, thank you very much. Um, and Diane,
you and I'll have to go peek at his peek
at what he did and see how he did it.
Because I'm curious, you know?Yeah,
no, it looks good. And yeah, it looks
good. Yeah, yeah, yeah, I think, I think
it's fun. This is this is going to be a
nice one to build out. This is this this.
So it's like, that's why I'm glad we're
doing these in Angular now these sites in
Angular not right, because when we have
these problems to solve and like we can
put some design in place and people.
Excited to see it and we get like, I
don't know it's it's sometimes you know,
what we can do on the CCS sites is or can
be sold like restricted and limited that
this is it's kind of fun now being in
this more modern environment. It's a ton
of work too, of course, right. And it's
just and I know fun isn't quotes like
right if I won the lottery tomorrow, this
is probably not how I would be having
fun, but. But but my
current net worth, I uh, I'm at work, so
I guess it's OK to enjoy some tasks more
than others. But uh, but yeah, I just
ohh, sorry, go ahead. No, I was just
gonna agree with you and say that I love
that you could just build it once and use
it again many, many times. Ohh, exactly
right. To have. Oh my God, everything,
everything in every file. Yeah. And this
is so nice. And if they wanted to tweak
it, OK, well, well, this particular
project has like 86 study guides, So now
we're updating 86 files. Yes. Like
whenever we had to do those pie chart
fixes. Oh my God. Ohh, yeah, this would
have been one code. Exactly,
yes, yes, Yep. So it's so nice you get
such a Big Bang for your buck. Yeah. If
you you know, you do that initial setup
properly, you get those JSON files in
place and then I mean, I mean, sure, in
the future maybe or do we have to tweak
the JSON files globally? Maybe, maybe,
who knows, but mostly it's. It's such a
more efficient way to work.
That's for sure. OK. Well, I think, I
think we've got, um, I think we've got a
good start on this one. We've got good
next steps in place now. Rich, thanks for
getting everything organized there with
the, with the tickets. Like I said, I'll
create that epic. So because we'll have
a, we'll have a number of different
separate stories to track on this one,
including when I'm back next week. Which
please do remind me to, umm, to chat with
you too about setting up, uh, a story for
the support team as well because we will
have to add these as purchase tables.
Yeah, I got a reminder that myself. Ohh.
Yeah. OK, instead of for, for Monday.
Ohh. And you know what else we need to
think about for UI is how to sell these
on the faculty practice test sales. Stage
that we're building now right because
like now we're gonna have you know, the
user on that page the user likes selects
the field and so we'll have to I guess
we'll just show them like 2 chunks of
information like practice test #1 and
practice test #2 and they'll and they can
if they want to buy only both the Tesla
for Tesla #1. We can do that if they want
to buy the bundle, both bundles, they can
do that, but these will you know these
will have to have a a name that
distinguishes it right So whether we call
it like form B or V2, I will have to come
up with something that sounds nice right?
Because there's going to be the user is
going to see this in their cart and see
this in their account when they after
they purchased it so we. We have to sort
of distinguish one version from theother.
Um, yeah, so let's think about that too,
OK?
Alright, well, I think that's enough for
today though. Thank you everybody. Ohh,
isn't it Matthew? I'm going to apologize.
I've just been, um, boy, I've had a lot
of back-to-back to back meetings. I've
got my feedback for the series HTML score
report done. So I'm just, I'm updating
the JIRA ticket now and I'll skip that
over to you, like hopefully within like
10 minutes. Umm.
And then because what I would like to do
is have you make those edits and then,
um, post those files back out to that
beta space. And then if everything looks
good, then I can just give Kerry the
links to those in that e-mail. And then,
and then I'll be done for the day.
OK, so I will ship these to
you quickly. Take care quickly
as well. OK, good. Matthew.
Thank you. OK, well, thanks a lot
everybody. I'll talk to you guys soon or
Monday whenever I guess that's even not
really that far, is it?