video tracking with the stamp
Archiver
Posts: 46,084
Hey group,
This is two part question.
Firstly, is it possible to real-time video track using the basicStamp and
a video cam(like the one from parallax), and would it be possible to not only
use it to detect presence or movement etc. but to head track and even more
precisely to track the direction a head is looking or even an eye?
The second is part, would be just for any help to direct me to some starting
point and/or info for hardware and programming advice or ideas to be able to
track an eye's direction of interest(or head to start out with)
All input is extremely appreciated and needed.
Thanks in advance,
jeff
[noparse][[/noparse]Non-text portions of this message have been removed]
This is two part question.
Firstly, is it possible to real-time video track using the basicStamp and
a video cam(like the one from parallax), and would it be possible to not only
use it to detect presence or movement etc. but to head track and even more
precisely to track the direction a head is looking or even an eye?
The second is part, would be just for any help to direct me to some starting
point and/or info for hardware and programming advice or ideas to be able to
track an eye's direction of interest(or head to start out with)
All input is extremely appreciated and needed.
Thanks in advance,
jeff
[noparse][[/noparse]Non-text portions of this message have been removed]
Comments
where the main presentation was from a gentlemen who makes very lifelike
human head robots. His robots do facial tracking, but all the
processing is done in a PC from a USB-fed camera.
-- Jon Williams
-- Applications Engineer, Parallax
-- Dallas Office
Original Message
From: jeff alten [noparse]/noparse]mailto:[url=http://forums.parallaxinc.com/group/basicstamps/post?postID=kqGhNRLXfgNMif5iWrA2a8l_yt3eYM8WXrBqpsVJg2WJqWvBaol0T5L4CZ7SxwAdZZmDU5rO2od0mGR4fOaiRA]jeffalten@h...[/url
Sent: Saturday, February 14, 2004 1:43 PM
To: basicstamps@yahoogroups.com
Subject: [noparse][[/noparse]basicstamps] video tracking with the stamp
Hey group,
This is two part question.
Firstly, is it possible to real-time video track using the
basicStamp and a video cam(like the one from parallax), and would it be
possible to not only use it to detect presence or movement etc. but to
head track and even more precisely to track the direction a head is
looking or even an eye?
The second is part, would be just for any help to direct me to some
starting point and/or info for hardware and programming advice or ideas
to be able to track an eye's direction of interest(or head to start out
with)
All input is extremely appreciated and needed.
Thanks in advance,
jeff
Thanks for the info, and speedy reply.
jeff
Original Message
From: "Jon Williams" <jwilliams@p...>
To: <basicstamps@yahoogroups.com>
Sent: Saturday, February 14, 2004 3:51 PM
Subject: RE: [noparse][[/noparse]basicstamps] video tracking with the stamp
> No, I don't think so. I just attended a DPRG (www.dprg.org) meeting
> where the main presentation was from a gentlemen who makes very lifelike
> human head robots. His robots do facial tracking, but all the
> processing is done in a PC from a USB-fed camera.
>
> -- Jon Williams
> -- Applications Engineer, Parallax
> -- Dallas Office
>
>
>
Original Message
> From: jeff alten [noparse]/noparse]mailto:[url=http://forums.parallaxinc.com/group/basicstamps/post?postID=URR2GsAI0jKpw_6FbqZhDNJNVn88uMluTGAHAHdxCbnO623UoHzr98GnDBnimvoJqy-My1oi2a-J24Iaja_ZIg]jeffalten@h...[/url
> Sent: Saturday, February 14, 2004 1:43 PM
> To: basicstamps@yahoogroups.com
> Subject: [noparse][[/noparse]basicstamps] video tracking with the stamp
>
>
> Hey group,
>
> This is two part question.
> Firstly, is it possible to real-time video track using the
> basicStamp and a video cam(like the one from parallax), and would it be
> possible to not only use it to detect presence or movement etc. but to
> head track and even more precisely to track the direction a head is
> looking or even an eye?
>
>
>
> The second is part, would be just for any help to direct me to some
> starting point and/or info for hardware and programming advice or ideas
> to be able to track an eye's direction of interest(or head to start out
> with)
>
> All input is extremely appreciated and needed.
> Thanks in advance,
> jeff
>
>
>
> To UNSUBSCRIBE, just send mail to:
> basicstamps-unsubscribe@yahoogroups.com
> from the same email address that you subscribed. Text in the Subject and
Body of the message will be ignored.
>
> Yahoo! Groups Links
>
>
>
>
>
>
I have been working with face tracking for two years now. This is how
much I could tell you in brief.
Basically there are three stages in face/head tracking:
1. The sensors. This could be anything from infra red reflective
paint to orientation sensors. Check out Intersense at www.isense.com.
Their products come with SDKs.
2. The interface to PC. This could be the Basic Stamp with an RS232
out or Ethernet out
3. A software on PC for 3D application or just data logging to
convert to a motion capture file format for other applications. I use
a software called Famous3D. Their website is at www.famous3d.com. It
has an SDK for you to develop your own software interface to their
product.
The next question is do you want real time processing or not. Real
time use low resolution video. The camera has to be head mounted for
stability. I have designed one with infra red LEDs and small CCD
camera. If you want detail capturing of facial movement, a high
resolution video is needed. You may need a separate capturing
hardware for that. Real time may not be possible. I used Matrox
Meteor card for capturing.
For all that been said Basic Stamp just don't have enough processing
power to do all that but perhaps part of it. May be the task can be
broken down to several Basic Stamps.
If you want to interface it to a PC, a good knowledge of DirectX will
makes things much easier.
- Johari Aziz
--- In basicstamps@yahoogroups.com, "jeff alten" <jeffalten@h...>
wrote:
> Jon,
> Thanks for the info, and speedy reply.
> jeff
>
Original Message
> From: "Jon Williams" <jwilliams@p...>
> To: <basicstamps@yahoogroups.com>
> Sent: Saturday, February 14, 2004 3:51 PM
> Subject: RE: [noparse][[/noparse]basicstamps] video tracking with the stamp
>
>
> > No, I don't think so. I just attended a DPRG (www.dprg.org)
meeting
> > where the main presentation was from a gentlemen who makes very
lifelike
> > human head robots. His robots do facial tracking, but all the
> > processing is done in a PC from a USB-fed camera.
> >
> > -- Jon Williams
> > -- Applications Engineer, Parallax
> > -- Dallas Office
> >
> >
> >
Original Message
> > From: jeff alten [noparse][[/noparse]mailto:jeffalten@h...]
> > Sent: Saturday, February 14, 2004 1:43 PM
> > To: basicstamps@yahoogroups.com
> > Subject: [noparse][[/noparse]basicstamps] video tracking with the stamp
> >
> >
> > Hey group,
> >
> > This is two part question.
> > Firstly, is it possible to real-time video track using the
> > basicStamp and a video cam(like the one from parallax), and would
it be
> > possible to not only use it to detect presence or movement etc.
but to
> > head track and even more precisely to track the direction a head
is
> > looking or even an eye?
> >
> >
> >
> > The second is part, would be just for any help to direct me
to some
> > starting point and/or info for hardware and programming advice or
ideas
> > to be able to track an eye's direction of interest(or head to
start out
> > with)
> >
> > All input is extremely appreciated and needed.
> > Thanks in advance,
> > jeff
> >
> >
> >
> > To UNSUBSCRIBE, just send mail to:
> > basicstamps-unsubscribe@yahoogroups.com
> > from the same email address that you subscribed. Text in the
Subject and
> Body of the message will be ignored.
> >
> > Yahoo! Groups Links
> >
> >
> >
> >
> >
> >
Thank you for the step by step launch pad, it is greatly appreciated and
is helping me move along in my research.
As a side note I was hoping to have real - time processing or ever so
slightly delayed.
sincerely,
jeff
Original Message
From: "Johari Aziz" <johaziz@y...>
To: <basicstamps@yahoogroups.com>
Sent: Sunday, February 15, 2004 4:52 AM
Subject: [noparse][[/noparse]basicstamps] Re: video tracking with the stamp
> Hi Jeff,
>
> I have been working with face tracking for two years now. This is how
> much I could tell you in brief.
>
> Basically there are three stages in face/head tracking:
>
> 1. The sensors. This could be anything from infra red reflective
> paint to orientation sensors. Check out Intersense at www.isense.com.
> Their products come with SDKs.
>
> 2. The interface to PC. This could be the Basic Stamp with an RS232
> out or Ethernet out
>
> 3. A software on PC for 3D application or just data logging to
> convert to a motion capture file format for other applications. I use
> a software called Famous3D. Their website is at www.famous3d.com. It
> has an SDK for you to develop your own software interface to their
> product.
>
> The next question is do you want real time processing or not. Real
> time use low resolution video. The camera has to be head mounted for
> stability. I have designed one with infra red LEDs and small CCD
> camera. If you want detail capturing of facial movement, a high
> resolution video is needed. You may need a separate capturing
> hardware for that. Real time may not be possible. I used Matrox
> Meteor card for capturing.
>
> For all that been said Basic Stamp just don't have enough processing
> power to do all that but perhaps part of it. May be the task can be
> broken down to several Basic Stamps.
>
> If you want to interface it to a PC, a good knowledge of DirectX will
> makes things much easier.
>
> - Johari Aziz
>
> --- In basicstamps@yahoogroups.com, "jeff alten" <jeffalten@h...>
> wrote:
> > Jon,
> > Thanks for the info, and speedy reply.
> > jeff
> >
Original Message
> > From: "Jon Williams" <jwilliams@p...>
> > To: <basicstamps@yahoogroups.com>
> > Sent: Saturday, February 14, 2004 3:51 PM
> > Subject: RE: [noparse][[/noparse]basicstamps] video tracking with the stamp
> >
> >
> > > No, I don't think so. I just attended a DPRG (www.dprg.org)
> meeting
> > > where the main presentation was from a gentlemen who makes very
> lifelike
> > > human head robots. His robots do facial tracking, but all the
> > > processing is done in a PC from a USB-fed camera.
> > >
> > > -- Jon Williams
> > > -- Applications Engineer, Parallax
> > > -- Dallas Office
> > >
> > >
> > >
Original Message
> > > From: jeff alten [noparse][[/noparse]mailto:jeffalten@h...]
> > > Sent: Saturday, February 14, 2004 1:43 PM
> > > To: basicstamps@yahoogroups.com
> > > Subject: [noparse][[/noparse]basicstamps] video tracking with the stamp
> > >
> > >
> > > Hey group,
> > >
> > > This is two part question.
> > > Firstly, is it possible to real-time video track using the
> > > basicStamp and a video cam(like the one from parallax), and would
> it be
> > > possible to not only use it to detect presence or movement etc.
> but to
> > > head track and even more precisely to track the direction a head
> is
> > > looking or even an eye?
> > >
> > >
> > >
> > > The second is part, would be just for any help to direct me
> to some
> > > starting point and/or info for hardware and programming advice or
> ideas
> > > to be able to track an eye's direction of interest(or head to
> start out
> > > with)
> > >
> > > All input is extremely appreciated and needed.
> > > Thanks in advance,
> > > jeff
> > >
> > >
> > >
> > > To UNSUBSCRIBE, just send mail to:
> > > basicstamps-unsubscribe@yahoogroups.com
> > > from the same email address that you subscribed. Text in the
> Subject and
> > Body of the message will be ignored.
> > >
> > > Yahoo! Groups Links
> > >
> > >
> > >
> > >
> > >
> > >
>
>
>
> To UNSUBSCRIBE, just send mail to:
> basicstamps-unsubscribe@yahoogroups.com
> from the same email address that you subscribed. Text in the Subject and
Body of the message will be ignored.
>
> Yahoo! Groups Links
>
>
>
>
>
>
As I had mentioned for real time you need to use very low resolution
video, perhaps non-standard format. It has to be processed by a
separate video capture hardware with it's own memory and output to
Basic Stamp in parallel format. If you want to sync audio with it,
you have to delay the audio with an audio delay unit to sync with the
video.
Orientation sensors usually output three signals, pitch, roll and
yaw. If you use DirectX on the PC you can use the joystick routine to
capture it. Another orientation sensors maker is Microstrain. their
site is at www.microstrain.com. Good luck and have fun.
- Johari
--- In basicstamps@yahoogroups.com, "jeff alten" <jeffalten@h...>
wrote:
> Johari,
> Thank you for the step by step launch pad, it is greatly
appreciated and
> is helping me move along in my research.
> As a side note I was hoping to have real - time processing or ever
so
> slightly delayed.
>
> sincerely,
> jeff
>
Original Message
> From: "Johari Aziz" <johaziz@y...>
> To: <basicstamps@yahoogroups.com>
> Sent: Sunday, February 15, 2004 4:52 AM
> Subject: [noparse][[/noparse]basicstamps] Re: video tracking with the stamp
>
>
> > Hi Jeff,
> >
> > I have been working with face tracking for two years now. This is
how
> > much I could tell you in brief.
> >
> > Basically there are three stages in face/head tracking:
> >
> > 1. The sensors. This could be anything from infra red reflective
> > paint to orientation sensors. Check out Intersense at
www.isense.com.
> > Their products come with SDKs.
> >
> > 2. The interface to PC. This could be the Basic Stamp with an
RS232
> > out or Ethernet out
> >
> > 3. A software on PC for 3D application or just data logging to
> > convert to a motion capture file format for other applications. I
use
> > a software called Famous3D. Their website is at www.famous3d.com.
It
> > has an SDK for you to develop your own software interface to their
> > product.
> >
> > The next question is do you want real time processing or not. Real
> > time use low resolution video. The camera has to be head mounted
for
> > stability. I have designed one with infra red LEDs and small CCD
> > camera. If you want detail capturing of facial movement, a high
> > resolution video is needed. You may need a separate capturing
> > hardware for that. Real time may not be possible. I used Matrox
> > Meteor card for capturing.
> >
> > For all that been said Basic Stamp just don't have enough
processing
> > power to do all that but perhaps part of it. May be the task can
be
> > broken down to several Basic Stamps.
> >
> > If you want to interface it to a PC, a good knowledge of DirectX
will
> > makes things much easier.
> >
> > - Johari Aziz
> >
> > --- In basicstamps@yahoogroups.com, "jeff alten" <jeffalten@h...>
> > wrote:
> > > Jon,
> > > Thanks for the info, and speedy reply.
> > > jeff
> > >
Original Message
> > > From: "Jon Williams" <jwilliams@p...>
> > > To: <basicstamps@yahoogroups.com>
> > > Sent: Saturday, February 14, 2004 3:51 PM
> > > Subject: RE: [noparse][[/noparse]basicstamps] video tracking with the stamp
> > >
> > >
> > > > No, I don't think so. I just attended a DPRG (www.dprg.org)
> > meeting
> > > > where the main presentation was from a gentlemen who makes
very
> > lifelike
> > > > human head robots. His robots do facial tracking, but all the
> > > > processing is done in a PC from a USB-fed camera.
> > > >
> > > > -- Jon Williams
> > > > -- Applications Engineer, Parallax
> > > > -- Dallas Office
> > > >
> > > >
> > > >
Original Message
> > > > From: jeff alten [noparse][[/noparse]mailto:jeffalten@h...]
> > > > Sent: Saturday, February 14, 2004 1:43 PM
> > > > To: basicstamps@yahoogroups.com
> > > > Subject: [noparse][[/noparse]basicstamps] video tracking with the stamp
> > > >
> > > >
> > > > Hey group,
> > > >
> > > > This is two part question.
> > > > Firstly, is it possible to real-time video track using
the
> > > > basicStamp and a video cam(like the one from parallax), and
would
> > it be
> > > > possible to not only use it to detect presence or movement
etc.
> > but to
> > > > head track and even more precisely to track the direction a
head
> > is
> > > > looking or even an eye?
> > > >
> > > >
> > > >
> > > > The second is part, would be just for any help to direct
me
> > to some
> > > > starting point and/or info for hardware and programming
advice or
> > ideas
> > > > to be able to track an eye's direction of interest(or head to
> > start out
> > > > with)
> > > >
> > > > All input is extremely appreciated and needed.
> > > > Thanks in advance,
> > > > jeff
> > > >
> > > >
> > > >
> > > > To UNSUBSCRIBE, just send mail to:
> > > > basicstamps-unsubscribe@yahoogroups.com
> > > > from the same email address that you subscribed. Text in the
> > Subject and
> > > Body of the message will be ignored.
> > > >
> > > > Yahoo! Groups Links
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> >
> >
> >
> > To UNSUBSCRIBE, just send mail to:
> > basicstamps-unsubscribe@yahoogroups.com
> > from the same email address that you subscribed. Text in the
Subject and
> Body of the message will be ignored.
> >
> > Yahoo! Groups Links
> >
> >
> >
> >
> >
> >